twitter_api-nlp-project.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "# Who said it on Twitter: Using the Twitter API and NLP to see which tweets are more likely to be yours\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Goals\n",
    "---\n",
    "\n",
    "Given two people We are going to attempt to classify which tweet came from whom.  There are a few steps to this:\n",
    "- Create a method to pull a list of tweets from the Twitter API\n",
    "- Perform proper preprocessing on our text\n",
    "- Engineer sentiment feature in our dataset using TextBlob\n",
    "- Explore supervised classification techniques\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Some Boring Twitter Rules\n",
    "---\n",
    "\n",
    "**Twitter notifies you they will rate limit your requests:**\n",
    "\n",
    ">THERE ARE LIMITS TO THE AMOUNT OF TIMES YOU CAN HIT THE API PER 15 MINUTE WINDOW. BEWARE!\n",
    "\n",
    "Here's a quick overview of what Twitter says are \"[the rules](https://dev.twitter.com/rest/public/rate-limiting)\":\n",
    "\n",
    "![](https://snag.gy/yJ6vIH.jpg)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 78,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T02:59:46.166742Z",
     "start_time": "2018-01-19T02:59:45.071376Z"
    }
   },
   "outputs": [],
   "source": [
    "import numpy as np\n",
    "import twitter, re, datetime, pandas as pd\n",
    "\n",
    "twitter_keys = {\n",
    "    'consumer_key':        'L4sziHBqV4VUIfKezbos0JMVl',\n",
    "    'consumer_secret':     'lJau6R7GIHFwoGR5wB3PlLQPXBChwzJFJ9WGXXtazcDSA1Vb1X',\n",
    "    'access_token_key':    '941359629606539264-05XcmQfdwMXTbPNWS3r7cZThvbQBxCK',\n",
    "    'access_token_secret': 'VdE3VJVk6oxbohQGcw7WYA5Tg4Sr8kW9duTO1wxmB6qXk'\n",
    "}\n",
    "\n",
    "api = twitter.Api(\n",
    "    consumer_key         =   twitter_keys['consumer_key'],\n",
    "    consumer_secret      =   twitter_keys['consumer_secret'],\n",
    "    access_token_key     =   twitter_keys['access_token_key'],\n",
    "    access_token_secret  =   twitter_keys['access_token_secret'],\n",
    "    tweet_mode = 'extended'\n",
    ")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 79,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T02:59:46.233452Z",
     "start_time": "2018-01-19T02:59:46.181990Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "twitter.api.Api"
      ]
     },
     "execution_count": 79,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "type(api)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Below I use the GetUserTimeline method of twitter.api.Api object to get tweet text and tweet details for a user. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 80,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T02:59:46.508476Z",
     "start_time": "2018-01-19T02:59:46.246265Z"
    }
   },
   "outputs": [],
   "source": [
    "# Note: Count can't be greater than 200\n",
    "x = api.GetUserTimeline(screen_name=\"HillaryClinton\", count=20, include_rts=False)\n",
    "x = [_.AsDict() for _ in x]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 81,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{u'created_at': u'Fri Jan 19 19:08:40 +0000 2018',\n",
       " u'favorite_count': 90621,\n",
       " u'full_text': u'I\\u2019m so heartened by all of you. Onward! https://t.co/vkRj7M3kBS',\n",
       " u'hashtags': [],\n",
       " u'id': 954430425321046016,\n",
       " u'id_str': u'954430425321046016',\n",
       " u'lang': u'en',\n",
       " u'quoted_status': {u'created_at': u'Thu Jan 18 14:06:08 +0000 2018',\n",
       "  u'favorite_count': 10541,\n",
       "  u'full_text': u'New @TIME cover: A year ago, they marched. Now a record number of women are running for office https://t.co/Uc9ivXGS2q via @CharlotteAlter https://t.co/8jnQ9gWmur',\n",
       "  u'hashtags': [],\n",
       "  u'id': 953991903250386944,\n",
       "  u'id_str': u'953991903250386944',\n",
       "  u'lang': u'en',\n",
       "  u'media': [{u'display_url': u'pic.twitter.com/8jnQ9gWmur',\n",
       "    u'expanded_url': u'https://twitter.com/TIMEPolitics/status/953991903250386944/photo/1',\n",
       "    u'id': 953991895411318784,\n",
       "    u'media_url': u'http://pbs.twimg.com/media/DT1CkwyX4AAkH5W.jpg',\n",
       "    u'media_url_https': u'https://pbs.twimg.com/media/DT1CkwyX4AAkH5W.jpg',\n",
       "    u'sizes': {u'large': {u'h': 1120, u'resize': u'fit', u'w': 840},\n",
       "     u'medium': {u'h': 1120, u'resize': u'fit', u'w': 840},\n",
       "     u'small': {u'h': 680, u'resize': u'fit', u'w': 510},\n",
       "     u'thumb': {u'h': 150, u'resize': u'crop', u'w': 150}},\n",
       "    u'type': u'photo',\n",
       "    u'url': u'https://t.co/8jnQ9gWmur'}],\n",
       "  u'retweet_count': 4020,\n",
       "  u'source': u'<a href=\"https://about.twitter.com/products/tweetdeck\" rel=\"nofollow\">TweetDeck</a>',\n",
       "  u'urls': [{u'expanded_url': u'http://ti.me/2DLOp0X',\n",
       "    u'url': u'https://t.co/Uc9ivXGS2q'}],\n",
       "  u'user': {u'created_at': u'Mon Aug 04 15:22:35 +0000 2008',\n",
       "   u'description': u\"Twitter feed for @TIME's politics channel\",\n",
       "   u'favourites_count': 31,\n",
       "   u'followers_count': 51699,\n",
       "   u'friends_count': 766,\n",
       "   u'id': 15723290,\n",
       "   u'lang': u'en',\n",
       "   u'listed_count': 1582,\n",
       "   u'name': u'TIMEPolitics',\n",
       "   u'profile_background_color': u'CC0000',\n",
       "   u'profile_background_image_url': u'http://abs.twimg.com/images/themes/theme1/bg.png',\n",
       "   u'profile_banner_url': u'https://pbs.twimg.com/profile_banners/15723290/1403549630',\n",
       "   u'profile_image_url': u'http://pbs.twimg.com/profile_images/481148089399398401/h_6VWChc_normal.jpeg',\n",
       "   u'profile_link_color': u'0000FF',\n",
       "   u'profile_sidebar_fill_color': u'FFFFFF',\n",
       "   u'profile_text_color': u'000000',\n",
       "   u'screen_name': u'TIMEPolitics',\n",
       "   u'statuses_count': 28224,\n",
       "   u'time_zone': u'Eastern Time (US & Canada)',\n",
       "   u'url': u'http://t.co/wOYDj1JmLA',\n",
       "   u'utc_offset': -18000},\n",
       "  u'user_mentions': [{u'id': 14293310,\n",
       "    u'name': u'TIME',\n",
       "    u'screen_name': u'TIME'},\n",
       "   {u'id': 774510134,\n",
       "    u'name': u'Charlotte Alter',\n",
       "    u'screen_name': u'CharlotteAlter'}]},\n",
       " u'quoted_status_id': 953991903250386944,\n",
       " u'quoted_status_id_str': u'953991903250386944',\n",
       " u'retweet_count': 16057,\n",
       " u'source': u'<a href=\"http://twitter.com/download/iphone\" rel=\"nofollow\">Twitter for iPhone</a>',\n",
       " u'urls': [{u'expanded_url': u'https://twitter.com/timepolitics/status/953991903250386944',\n",
       "   u'url': u'https://t.co/vkRj7M3kBS'}],\n",
       " u'user': {u'created_at': u'Tue Apr 09 18:04:35 +0000 2013',\n",
       "  u'description': u'Wife, mom, grandma, women+kids advocate, FLOTUS, Senator, SecState, hair icon, pantsuit aficionado, 2016 presidential candidate.',\n",
       "  u'favourites_count': 1163,\n",
       "  u'followers_count': 21440695,\n",
       "  u'friends_count': 770,\n",
       "  u'geo_enabled': True,\n",
       "  u'id': 1339835893,\n",
       "  u'lang': u'en',\n",
       "  u'listed_count': 39569,\n",
       "  u'location': u'New York, NY',\n",
       "  u'name': u'Hillary Clinton',\n",
       "  u'profile_background_color': u'0057B8',\n",
       "  u'profile_background_image_url': u'http://abs.twimg.com/images/themes/theme1/bg.png',\n",
       "  u'profile_banner_url': u'https://pbs.twimg.com/profile_banners/1339835893/1476893928',\n",
       "  u'profile_image_url': u'http://pbs.twimg.com/profile_images/839938827837976576/leN1zJJx_normal.jpg',\n",
       "  u'profile_link_color': u'0057B8',\n",
       "  u'profile_sidebar_fill_color': u'000000',\n",
       "  u'profile_text_color': u'000000',\n",
       "  u'screen_name': u'HillaryClinton',\n",
       "  u'statuses_count': 10037,\n",
       "  u'time_zone': u'Eastern Time (US & Canada)',\n",
       "  u'url': u'https://t.co/xhPHAcdCwE',\n",
       "  u'utc_offset': -18000,\n",
       "  u'verified': True},\n",
       " u'user_mentions': []}"
      ]
     },
     "execution_count": 81,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "x[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 82,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T02:59:46.510087Z",
     "start_time": "2018-01-19T02:59:46.448Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "954430425321046016\n",
      "I’m so heartened by all of you. Onward! https://t.co/vkRj7M3kBS\n",
      "--\n",
      "953005910930153472\n",
      "These words from Dr. King also come to mind today: https://t.co/0qFK3RxBAF\n",
      "--\n",
      "952958227825782784\n",
      "Beautifully said, @BerniceKing. An important message today and every day. https://t.co/eYJAGc6i2b\n",
      "--\n",
      "951895239140298752\n",
      "The anniversary of the devastating earthquake 8 years ago is a day to remember the tragedy, honor the resilient people of Haiti, &amp; affirm America’s commitment to helping our neighbors. Instead, we‘re subjected to Trump’s ignorant, racist views of anyone who doesn’t look like him.\n",
      "--\n",
      "951651923328987136\n",
      "@NancyEMcFadden Nancy has a record of beating the odds - from DC to CA - where she helped Gov Brown do a fantastic job. All who know her are sending strength &amp; love as she faces this latest challenge.  Onward my friend. -H\n",
      "--\n",
      "948244463138328577\n",
      "Families across America had to start 2018 worried that their kids wouldn’t have health care. Failing to act now shows the true face of Republicans &amp; their donor-driven immoral agenda. You control the Senate agenda @SenateMajLdr. Enough is enough.\n",
      "--\n",
      "948244159986651136\n",
      "Time to bring CHIP to the Senate floor as promised. This alleged extension until March doesn’t cut it as states freeze enrollment &amp; send out letters warning that coverage will end. This is frightening to parents &amp; wreaks havoc for states. https://t.co/tWtm211w8S\n",
      "--\n",
      "947313751992274944\n",
      "The Iranian people, especially the young, are protesting for the freedom and future they deserve. I hope their government responds peacefully and supports their hopes.\n",
      "--\n",
      "944279653883228160\n",
      "Thank you to everyone who has donated to Onward Together in our first year -- we’re only able to support these great groups because of you. Let’s do even more in 2018. Onward!\n",
      "--\n",
      "944279421065814016\n",
      "Along with @IndivisibleTeam, @ColorOfChange, @EmergeAmerica, @swingleft, and @runforsomething, I know these groups will continue to do the incredible work of making our democracy stronger in 2018, and I'm proud to be on their team.\n",
      "--\n",
      "944279114172850177\n",
      "And with the help of @collectivepac, 23 African-American candidates have been elected to local, state, and federal offices since August 2016.\n",
      "--\n",
      "944278916621066240\n",
      "More than 400 students and leaders met last month at the @votolatino Power Summit to share resources and tools for national advocacy.\n",
      "--\n",
      "944278786874527744\n",
      "The team at @latinovictoryus is working to elect more Latino candidates at every level of government.\n",
      "--\n",
      "944278119237681152\n",
      "At @alliance4youth, young people are using local organizing to address economic inequality, attacks on voting rights, and more.\n",
      "--\n",
      "944277880028237826\n",
      "450 brand-new civic leaders and activists attended the very first @ArenaSummit -- and they're on track to train 5,000 people by the end of 2018.\n",
      "--\n"
     ]
    }
   ],
   "source": [
    "#printing id and text of tweets\n",
    "for element in x:\n",
    "    print element['id']\n",
    "    print(element['full_text'])\n",
    "    print('--')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 83,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T02:59:47.201665Z",
     "start_time": "2018-01-19T02:59:47.153042Z"
    },
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# From the docs: \"Max id returns results with an ID less than (older than) or equal to the\n",
    "# specified ID. \n",
    "y = api.GetUserTimeline(screen_name=\"HillaryClinton\", count=20, max_id=935706980643147777, include_rts=False)\n",
    "y = [_.AsDict() for _ in y]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 84,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:29:24.046155Z",
     "start_time": "2018-01-19T01:29:24.034438Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "933449899487780864\n",
      "You go girl! This is important; costs will go up, &amp; powerful companies will get more powerful. We can’t let it slip through the cracks. https://t.co/js4agpzKeS\n",
      "--\n",
      "933107180131282944\n",
      "And on top of that, you can’t beat a little book signing wardrobe fun.\n",
      "\n",
      "https://t.co/K8VldCmTC6 https://t.co/9q9sTlpL3I\n",
      "--\n",
      "933105980484747264\n",
      "And being out on the book tour it has been wonderful to hear from so many people about their activism, their courage, &amp; their resilience.\n",
      "https://t.co/LhtTwV7N0d\n",
      "--\n",
      "933105682378870784\n",
      "Wow. I wasn’t sure how letting my guard down would go...but it’s been cathartic &amp; rewarding. I loved writing this book, &amp; I’m honored to be in such great company on this list!\n",
      "https://t.co/rAYpWHzxrJ\n",
      "--\n",
      "932746529475055618\n",
      "It’s been almost 2 months since Congress let the program that provides health care for 9 million children expire. Call Congress &amp; tell them to reauthorize CHIP now: 202-224-3121 https://t.co/jk1FhOcMp2\n",
      "--\n",
      "931292276709580802\n",
      "It’s true! I want to join your book club to talk about What Happened &amp; what’s happening...sign up! https://t.co/hmWiCrBgsq\n",
      "--\n",
      "931292070312140804\n",
      "@BenSPLATT @DearEvanHansen Two friends on a perfect day. Sincerely, me.\n",
      "--\n",
      "931167854828883968\n",
      "Good. https://t.co/IqanY3F28F\n",
      "--\n",
      "930540319606747137\n",
      "Being your candidate was the honor of a lifetime. Now it's your turn to #runforsomething: https://t.co/ODzNQEossm\n",
      "--\n",
      "930519362158686209\n",
      "Looking forward to a great discussion with my friend Dorothy and to a great day @UVA! Tune in:\n",
      "https://t.co/L20mjSwhCR https://t.co/02ALVZAAKZ\n",
      "--\n",
      "930082055278428160\n",
      "Join me live this morning at 9:45am for an important discussion about child &amp; adolescent mental health, focused on solutions for families &amp; communities. #ChildMindSummit \n",
      "https://t.co/317gv59kHQ\n",
      "--\n",
      "929862099446181888\n",
      "Proud of you, Becca! \n",
      "https://t.co/xAY3yzdf7f https://t.co/lEo1f5eYDq\n",
      "--\n",
      "929749504131289088\n",
      "It was a thrill to work on this project with @ElaineWelteroth.  I’m really proud of the result. I hope you enjoy it. https://t.co/MILM8WdvOg\n",
      "--\n"
     ]
    }
   ],
   "source": [
    "for element in y:\n",
    "    print element['id']\n",
    "    print(element['full_text'])\n",
    "    print('--')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 85,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:29:48.669067Z",
     "start_time": "2018-01-19T01:29:48.663801Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "dict"
      ]
     },
     "execution_count": 85,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "type(y[0])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 86,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:44:26.096651Z",
     "start_time": "2018-01-19T01:44:26.090618Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "933449899487780864"
      ]
     },
     "execution_count": 86,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "y[0]['id']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 87,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:54:01.209215Z",
     "start_time": "2018-01-19T01:54:01.186226Z"
    },
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "#TweetMiner function from Mike Roman\n",
    "\n",
    "class TweetMiner(object):\n",
    "\n",
    "    \n",
    "    def __init__(self, api, result_limit = 20):\n",
    "        \n",
    "        self.api = api        \n",
    "        self.result_limit = result_limit\n",
    "        \n",
    "\n",
    "    def mine_user_tweets(self, user=\"HillaryClinton\", mine_retweets=False, max_pages=20):\n",
    "\n",
    "        data           =  []\n",
    "        last_tweet_id  =  False\n",
    "        page           =  1\n",
    "        \n",
    "        while page <= max_pages:\n",
    "            \n",
    "            if last_tweet_id:\n",
    "                statuses   =   self.api.GetUserTimeline(screen_name=user, count=self.result_limit, max_id=last_tweet_id - 1, include_rts=mine_retweets)\n",
    "                statuses = [ _.AsDict() for _ in statuses]\n",
    "            else:\n",
    "                statuses   =   self.api.GetUserTimeline(screen_name=user, count=self.result_limit, include_rts=mine_retweets)\n",
    "                statuses = [_.AsDict() for _ in statuses]\n",
    "                \n",
    "            for item in statuses:\n",
    "                # Using try except here.\n",
    "                # When retweets = 0 we get an error (GetUserTimeline fails to create a key, 'retweet_count')\n",
    "                try:\n",
    "                    mined = {\n",
    "                        'tweet_id':        item['id'],\n",
    "                        'handle':          item['user']['screen_name'],\n",
    "                        'retweet_count':   item['retweet_count'],\n",
    "                        'text':            item['full_text'],\n",
    "                        'mined_at':        datetime.datetime.now(),\n",
    "                        'created_at':      item['created_at'],\n",
    "                    }\n",
    "                \n",
    "                except:\n",
    "                        mined = {\n",
    "                        'tweet_id':        item['id'],\n",
    "                        'handle':          item['user']['screen_name'],\n",
    "                        'retweet_count':   0,\n",
    "                        'text':            item['full_text'],\n",
    "                        'mined_at':        datetime.datetime.now(),\n",
    "                        'created_at':      item['created_at'],\n",
    "                    }\n",
    "                \n",
    "                last_tweet_id = item['id']\n",
    "                data.append(mined)\n",
    "                \n",
    "            page += 1\n",
    "            \n",
    "        return data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Instantiate the class\n",
    "---\n",
    "\n",
    "Make sure you pass the keys dictionary and the api as arguments.\n",
    "\n",
    "**Check:** call the object's `mine_user_tweets()` method, providing a user to pull the tweets of."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 88,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:54:02.100901Z",
     "start_time": "2018-01-19T01:54:02.096789Z"
    },
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# Result limit == count parameter from our GetUserTimeline()\n",
    "miner = TweetMiner(api, result_limit=200)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 89,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:54:19.428318Z",
     "start_time": "2018-01-19T01:54:02.820962Z"
    },
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "hillary = miner.mine_user_tweets(user=\"HillaryClinton\")\n",
    "donald = miner.mine_user_tweets(user=\"realDonaldTrump\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 90,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:54:19.440456Z",
     "start_time": "2018-01-19T01:54:19.430060Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "I’m so heartened by all of you. Onward! https://t.co/vkRj7M3kBS\n",
      "---\n",
      "These words from Dr. King also come to mind today: https://t.co/0qFK3RxBAF\n",
      "---\n",
      "Beautifully said, @BerniceKing. An important message today and every day. https://t.co/eYJAGc6i2b\n",
      "---\n",
      "The anniversary of the devastating earthquake 8 years ago is a day to remember the tragedy, honor the resilient people of Haiti, &amp; affirm America’s commitment to helping our neighbors. Instead, we‘re subjected to Trump’s ignorant, racist views of anyone who doesn’t look like him.\n",
      "---\n",
      "@NancyEMcFadden Nancy has a record of beating the odds - from DC to CA - where she helped Gov Brown do a fantastic job. All who know her are sending strength &amp; love as she faces this latest challenge.  Onward my friend. -H\n",
      "---\n"
     ]
    }
   ],
   "source": [
    "for x in range(5):\n",
    "    print hillary[x]['text']\n",
    "    print('---')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 91,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:54:19.451706Z",
     "start_time": "2018-01-19T01:54:19.443341Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Not looking good for our great Military or Safety &amp; Security on the very dangerous Southern Border. Dems want a Shutdown in order to help diminish the great success of the Tax Cuts, and what they are doing for our booming economy.\n",
      "--\n",
      "Excellent preliminary meeting in Oval with @SenSchumer - working on solutions for Security and our great Military together with @SenateMajLdr McConnell and @SpeakerRyan. Making progress - four week extension would be best!\n",
      "--\n",
      "Just signed 702 Bill to reauthorize foreign intelligence collection. This is NOT the same FISA law that was so wrongly abused during the election. I will always do the right thing for our country and put the safety of the American people first!\n",
      "--\n",
      "Today, I was honored and proud to address the 45th Annual @March_for_Life! You are living witnesses of this year’s March for Life theme: #LoveSavesLives. https://t.co/DMST4qhDmp\n",
      "--\n",
      "“Shutting down the government is a very serious thing. People die, accidents happen. I don’t know how I would vote right now on a CR, OK?”\n",
      "Sen. Dianne Feinstein (D-Calif)\n",
      "https://t.co/7xP3CBnv5j\n",
      "--\n"
     ]
    }
   ],
   "source": [
    "for x in range(5):\n",
    "    print donald[x]['text']\n",
    "    print('--')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Convert the tweet ouputs to a pandas DataFrame"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 92,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:54:19.614877Z",
     "start_time": "2018-01-19T01:54:19.455771Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>created_at</th>\n",
       "      <th>handle</th>\n",
       "      <th>mined_at</th>\n",
       "      <th>retweet_count</th>\n",
       "      <th>text</th>\n",
       "      <th>tweet_id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Fri Jan 19 19:08:40 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529365</td>\n",
       "      <td>16059</td>\n",
       "      <td>I’m so heartened by all of you. Onward! https:...</td>\n",
       "      <td>954430425321046016</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Mon Jan 15 20:48:09 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529391</td>\n",
       "      <td>23021</td>\n",
       "      <td>These words from Dr. King also come to mind to...</td>\n",
       "      <td>953005910930153472</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Mon Jan 15 17:38:41 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529402</td>\n",
       "      <td>8990</td>\n",
       "      <td>Beautifully said, @BerniceKing. An important m...</td>\n",
       "      <td>952958227825782784</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Fri Jan 12 19:14:45 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529413</td>\n",
       "      <td>59635</td>\n",
       "      <td>The anniversary of the devastating earthquake ...</td>\n",
       "      <td>951895239140298752</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Fri Jan 12 03:07:54 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529421</td>\n",
       "      <td>320</td>\n",
       "      <td>@NancyEMcFadden Nancy has a record of beating ...</td>\n",
       "      <td>951651923328987136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Tue Jan 02 17:27:52 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529430</td>\n",
       "      <td>8529</td>\n",
       "      <td>Families across America had to start 2018 worr...</td>\n",
       "      <td>948244463138328577</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Tue Jan 02 17:26:39 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529438</td>\n",
       "      <td>14714</td>\n",
       "      <td>Time to bring CHIP to the Senate floor as prom...</td>\n",
       "      <td>948244159986651136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Sun Dec 31 03:49:33 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529447</td>\n",
       "      <td>20666</td>\n",
       "      <td>The Iranian people, especially the young, are ...</td>\n",
       "      <td>947313751992274944</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Fri Dec 22 18:53:08 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529454</td>\n",
       "      <td>3153</td>\n",
       "      <td>Thank you to everyone who has donated to Onwar...</td>\n",
       "      <td>944279653883228160</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Fri Dec 22 18:52:12 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529462</td>\n",
       "      <td>2478</td>\n",
       "      <td>Along with @IndivisibleTeam, @ColorOfChange, @...</td>\n",
       "      <td>944279421065814016</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>Fri Dec 22 18:50:59 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529470</td>\n",
       "      <td>1633</td>\n",
       "      <td>And with the help of @collectivepac, 23 Africa...</td>\n",
       "      <td>944279114172850177</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Fri Dec 22 18:50:12 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529478</td>\n",
       "      <td>1260</td>\n",
       "      <td>More than 400 students and leaders met last mo...</td>\n",
       "      <td>944278916621066240</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Fri Dec 22 18:49:41 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529485</td>\n",
       "      <td>1426</td>\n",
       "      <td>The team at @latinovictoryus is working to ele...</td>\n",
       "      <td>944278786874527744</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Fri Dec 22 18:47:02 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529493</td>\n",
       "      <td>1355</td>\n",
       "      <td>At @alliance4youth, young people are using loc...</td>\n",
       "      <td>944278119237681152</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Fri Dec 22 18:46:05 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529500</td>\n",
       "      <td>1516</td>\n",
       "      <td>450 brand-new civic leaders and activists atte...</td>\n",
       "      <td>944277880028237826</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Fri Dec 22 18:45:12 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529507</td>\n",
       "      <td>1869</td>\n",
       "      <td>The organizers at @iVoteFund worked with partn...</td>\n",
       "      <td>944277660087324674</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Fri Dec 22 18:44:06 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529514</td>\n",
       "      <td>11655</td>\n",
       "      <td>Onward Together is ending 2017 by supporting s...</td>\n",
       "      <td>944277382684463105</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Wed Dec 20 19:51:11 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529522</td>\n",
       "      <td>17938</td>\n",
       "      <td>Something productive to do with your outrage t...</td>\n",
       "      <td>943569489664278533</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>Wed Dec 20 02:14:53 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529529</td>\n",
       "      <td>7047</td>\n",
       "      <td>I guest-edited this month’s issue of @TeenVogu...</td>\n",
       "      <td>943303660540452870</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>Tue Dec 19 22:57:23 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529537</td>\n",
       "      <td>1431</td>\n",
       "      <td>A little girl power in Pasadena...\\nhttps://t....</td>\n",
       "      <td>943253960139460611</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Sat Dec 16 18:47:01 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529544</td>\n",
       "      <td>3349</td>\n",
       "      <td>Some photos from the book tour. I met so many ...</td>\n",
       "      <td>942103788890021888</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>Sat Dec 16 02:52:31 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529552</td>\n",
       "      <td>4418</td>\n",
       "      <td>Returning home after the final week of the boo...</td>\n",
       "      <td>941863582710620160</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>Fri Dec 15 21:46:30 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529559</td>\n",
       "      <td>1956</td>\n",
       "      <td>Thank you to the @lapromisefund &amp;amp; @msjwill...</td>\n",
       "      <td>941786571837181953</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>Fri Dec 15 17:46:05 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529566</td>\n",
       "      <td>8415</td>\n",
       "      <td>Today is the final day to sign up for 2018 hea...</td>\n",
       "      <td>941726067638681600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>Thu Dec 14 19:33:00 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529573</td>\n",
       "      <td>591</td>\n",
       "      <td>@ELaffGarb @DHochsprung @ELaffGarb, thinking o...</td>\n",
       "      <td>941390586845597696</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>Wed Dec 13 05:16:39 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529580</td>\n",
       "      <td>12958</td>\n",
       "      <td>Yes!\\nElections matter. https://t.co/xU8dpew1Cn</td>\n",
       "      <td>940812691924496385</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>Wed Dec 13 03:32:06 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529589</td>\n",
       "      <td>86064</td>\n",
       "      <td>Tonight, Alabama voters elected a senator who'...</td>\n",
       "      <td>940786378069049344</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>Wed Dec 13 01:13:20 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529596</td>\n",
       "      <td>5023</td>\n",
       "      <td>Mayor Ed Lee’s death is a terrible loss for th...</td>\n",
       "      <td>940751455782391808</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>Sat Dec 09 00:32:27 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529604</td>\n",
       "      <td>3121</td>\n",
       "      <td>If you don't live in an area that could be aff...</td>\n",
       "      <td>939291618250842112</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>Sat Dec 09 00:31:11 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:40.529610</td>\n",
       "      <td>4925</td>\n",
       "      <td>Thinking about all affected &amp;amp; those who co...</td>\n",
       "      <td>939291298678362113</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2537</th>\n",
       "      <td>Tue Jul 26 03:22:21 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063364</td>\n",
       "      <td>2342</td>\n",
       "      <td>\"I served with her in the United States Senate...</td>\n",
       "      <td>757778054815047680</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2538</th>\n",
       "      <td>Tue Jul 26 03:18:21 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063371</td>\n",
       "      <td>4968</td>\n",
       "      <td>\"While...Trump is busy insulting one group aft...</td>\n",
       "      <td>757777047523557376</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2539</th>\n",
       "      <td>Tue Jul 26 03:17:02 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063378</td>\n",
       "      <td>2587</td>\n",
       "      <td>\"Donald Trump? Well, like most Republicans, he...</td>\n",
       "      <td>757776714273546241</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2540</th>\n",
       "      <td>Tue Jul 26 03:10:01 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063385</td>\n",
       "      <td>2667</td>\n",
       "      <td>“Hillary Clinton will nominate justices to the...</td>\n",
       "      <td>757774948928720896</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2541</th>\n",
       "      <td>Tue Jul 26 03:07:41 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063392</td>\n",
       "      <td>2711</td>\n",
       "      <td>\"Hillary...understands that if someone in this...</td>\n",
       "      <td>757774363458433024</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2542</th>\n",
       "      <td>Tue Jul 26 03:06:12 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063399</td>\n",
       "      <td>4911</td>\n",
       "      <td>\"Hillary Clinton must become the next presiden...</td>\n",
       "      <td>757773990173806592</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2543</th>\n",
       "      <td>Tue Jul 26 03:04:28 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063406</td>\n",
       "      <td>2031</td>\n",
       "      <td>\"We have come a long way in the last 7 1/2 yea...</td>\n",
       "      <td>757773551751598080</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2544</th>\n",
       "      <td>Tue Jul 26 02:55:53 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063413</td>\n",
       "      <td>723</td>\n",
       "      <td>Happening now: Watch @BernieSanders address th...</td>\n",
       "      <td>757771391093600256</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2545</th>\n",
       "      <td>Tue Jul 26 02:49:57 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063420</td>\n",
       "      <td>2171</td>\n",
       "      <td>\"Trump’s entire campaign is just one more, lat...</td>\n",
       "      <td>757769901402681344</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2546</th>\n",
       "      <td>Tue Jul 26 02:46:55 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063427</td>\n",
       "      <td>3417</td>\n",
       "      <td>Couldn’t agree more, @POTUS. https://t.co/hvsf...</td>\n",
       "      <td>757769136269320193</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2547</th>\n",
       "      <td>Tue Jul 26 02:45:12 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063434</td>\n",
       "      <td>1638</td>\n",
       "      <td>“If you believe we are stronger together, then...</td>\n",
       "      <td>757768703521988610</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2548</th>\n",
       "      <td>Tue Jul 26 02:42:12 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063441</td>\n",
       "      <td>2390</td>\n",
       "      <td>“We’re not going to be Donald Trump’s hate-fil...</td>\n",
       "      <td>757767949327400964</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2549</th>\n",
       "      <td>Tue Jul 26 02:41:43 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063447</td>\n",
       "      <td>1878</td>\n",
       "      <td>\"When we turn on each other, we can’t unite to...</td>\n",
       "      <td>757767826648231936</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2550</th>\n",
       "      <td>Tue Jul 26 02:39:51 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063455</td>\n",
       "      <td>1499</td>\n",
       "      <td>“That’s Donald Trump’s America—an America of f...</td>\n",
       "      <td>757767359843147776</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2551</th>\n",
       "      <td>Tue Jul 26 02:39:19 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063462</td>\n",
       "      <td>2381</td>\n",
       "      <td>\"He even picked a vice president famous for tr...</td>\n",
       "      <td>757767223134093316</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2552</th>\n",
       "      <td>Tue Jul 26 02:37:02 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063469</td>\n",
       "      <td>3570</td>\n",
       "      <td>\"Last week...Trump spoke for more than an hour...</td>\n",
       "      <td>757766649474912257</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2553</th>\n",
       "      <td>Tue Jul 26 02:36:29 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063476</td>\n",
       "      <td>2691</td>\n",
       "      <td>\"What kind of a man cheats students, cheats in...</td>\n",
       "      <td>757766513013194752</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2554</th>\n",
       "      <td>Tue Jul 26 02:34:40 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063482</td>\n",
       "      <td>2648</td>\n",
       "      <td>\"What kind of a man roots for an economic cras...</td>\n",
       "      <td>757766052428312576</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2555</th>\n",
       "      <td>Tue Jul 26 02:34:01 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063489</td>\n",
       "      <td>1600</td>\n",
       "      <td>\"He preyed on...people who had fallen on hard ...</td>\n",
       "      <td>757765891908132864</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2556</th>\n",
       "      <td>Tue Jul 26 02:27:48 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063497</td>\n",
       "      <td>454</td>\n",
       "      <td>Watch @ElizabethForMA live at the #DemConventi...</td>\n",
       "      <td>757764326128283648</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2557</th>\n",
       "      <td>Tue Jul 26 02:26:28 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063504</td>\n",
       "      <td>3971</td>\n",
       "      <td>\"Hillary Clinton has never quit on anything in...</td>\n",
       "      <td>757763989359173632</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2558</th>\n",
       "      <td>Tue Jul 26 02:21:30 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063511</td>\n",
       "      <td>2597</td>\n",
       "      <td>\"We need to pour every last ounce of our passi...</td>\n",
       "      <td>757762738433191936</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2559</th>\n",
       "      <td>Tue Jul 26 02:20:08 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063519</td>\n",
       "      <td>5081</td>\n",
       "      <td>\"Don’t let anyone ever tell you that this coun...</td>\n",
       "      <td>757762395787911168</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2560</th>\n",
       "      <td>Tue Jul 26 02:19:26 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063526</td>\n",
       "      <td>4801</td>\n",
       "      <td>“Because of Hillary Clinton, my daughters…now ...</td>\n",
       "      <td>757762219300052992</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2561</th>\n",
       "      <td>Tue Jul 26 02:16:18 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063533</td>\n",
       "      <td>2552</td>\n",
       "      <td>\"Hillary understands that the presidency is ab...</td>\n",
       "      <td>757761430477279232</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2562</th>\n",
       "      <td>Tue Jul 26 02:16:01 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063541</td>\n",
       "      <td>1893</td>\n",
       "      <td>\"In this election, I’m with her!\" —@FLOTUS on ...</td>\n",
       "      <td>757761359035699200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2563</th>\n",
       "      <td>Tue Jul 26 02:15:11 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063547</td>\n",
       "      <td>2219</td>\n",
       "      <td>\"We don’t turn against each other—no, we liste...</td>\n",
       "      <td>757761152231346176</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2564</th>\n",
       "      <td>Tue Jul 26 02:14:14 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063555</td>\n",
       "      <td>1496</td>\n",
       "      <td>\"Hillary Clinton has never quit on anything in...</td>\n",
       "      <td>757760912581419008</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2565</th>\n",
       "      <td>Tue Jul 26 02:12:21 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063562</td>\n",
       "      <td>3985</td>\n",
       "      <td>\"When she didn’t win the nomination 8 years ag...</td>\n",
       "      <td>757760436842459137</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2566</th>\n",
       "      <td>Tue Jul 26 02:10:21 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 02:08:49.063569</td>\n",
       "      <td>2453</td>\n",
       "      <td>\"There is only one person...truly qualified to...</td>\n",
       "      <td>757759935136600064</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2567 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                          created_at          handle  \\\n",
       "0     Fri Jan 19 19:08:40 +0000 2018  HillaryClinton   \n",
       "1     Mon Jan 15 20:48:09 +0000 2018  HillaryClinton   \n",
       "2     Mon Jan 15 17:38:41 +0000 2018  HillaryClinton   \n",
       "3     Fri Jan 12 19:14:45 +0000 2018  HillaryClinton   \n",
       "4     Fri Jan 12 03:07:54 +0000 2018  HillaryClinton   \n",
       "5     Tue Jan 02 17:27:52 +0000 2018  HillaryClinton   \n",
       "6     Tue Jan 02 17:26:39 +0000 2018  HillaryClinton   \n",
       "7     Sun Dec 31 03:49:33 +0000 2017  HillaryClinton   \n",
       "8     Fri Dec 22 18:53:08 +0000 2017  HillaryClinton   \n",
       "9     Fri Dec 22 18:52:12 +0000 2017  HillaryClinton   \n",
       "10    Fri Dec 22 18:50:59 +0000 2017  HillaryClinton   \n",
       "11    Fri Dec 22 18:50:12 +0000 2017  HillaryClinton   \n",
       "12    Fri Dec 22 18:49:41 +0000 2017  HillaryClinton   \n",
       "13    Fri Dec 22 18:47:02 +0000 2017  HillaryClinton   \n",
       "14    Fri Dec 22 18:46:05 +0000 2017  HillaryClinton   \n",
       "15    Fri Dec 22 18:45:12 +0000 2017  HillaryClinton   \n",
       "16    Fri Dec 22 18:44:06 +0000 2017  HillaryClinton   \n",
       "17    Wed Dec 20 19:51:11 +0000 2017  HillaryClinton   \n",
       "18    Wed Dec 20 02:14:53 +0000 2017  HillaryClinton   \n",
       "19    Tue Dec 19 22:57:23 +0000 2017  HillaryClinton   \n",
       "20    Sat Dec 16 18:47:01 +0000 2017  HillaryClinton   \n",
       "21    Sat Dec 16 02:52:31 +0000 2017  HillaryClinton   \n",
       "22    Fri Dec 15 21:46:30 +0000 2017  HillaryClinton   \n",
       "23    Fri Dec 15 17:46:05 +0000 2017  HillaryClinton   \n",
       "24    Thu Dec 14 19:33:00 +0000 2017  HillaryClinton   \n",
       "25    Wed Dec 13 05:16:39 +0000 2017  HillaryClinton   \n",
       "26    Wed Dec 13 03:32:06 +0000 2017  HillaryClinton   \n",
       "27    Wed Dec 13 01:13:20 +0000 2017  HillaryClinton   \n",
       "28    Sat Dec 09 00:32:27 +0000 2017  HillaryClinton   \n",
       "29    Sat Dec 09 00:31:11 +0000 2017  HillaryClinton   \n",
       "...                              ...             ...   \n",
       "2537  Tue Jul 26 03:22:21 +0000 2016  HillaryClinton   \n",
       "2538  Tue Jul 26 03:18:21 +0000 2016  HillaryClinton   \n",
       "2539  Tue Jul 26 03:17:02 +0000 2016  HillaryClinton   \n",
       "2540  Tue Jul 26 03:10:01 +0000 2016  HillaryClinton   \n",
       "2541  Tue Jul 26 03:07:41 +0000 2016  HillaryClinton   \n",
       "2542  Tue Jul 26 03:06:12 +0000 2016  HillaryClinton   \n",
       "2543  Tue Jul 26 03:04:28 +0000 2016  HillaryClinton   \n",
       "2544  Tue Jul 26 02:55:53 +0000 2016  HillaryClinton   \n",
       "2545  Tue Jul 26 02:49:57 +0000 2016  HillaryClinton   \n",
       "2546  Tue Jul 26 02:46:55 +0000 2016  HillaryClinton   \n",
       "2547  Tue Jul 26 02:45:12 +0000 2016  HillaryClinton   \n",
       "2548  Tue Jul 26 02:42:12 +0000 2016  HillaryClinton   \n",
       "2549  Tue Jul 26 02:41:43 +0000 2016  HillaryClinton   \n",
       "2550  Tue Jul 26 02:39:51 +0000 2016  HillaryClinton   \n",
       "2551  Tue Jul 26 02:39:19 +0000 2016  HillaryClinton   \n",
       "2552  Tue Jul 26 02:37:02 +0000 2016  HillaryClinton   \n",
       "2553  Tue Jul 26 02:36:29 +0000 2016  HillaryClinton   \n",
       "2554  Tue Jul 26 02:34:40 +0000 2016  HillaryClinton   \n",
       "2555  Tue Jul 26 02:34:01 +0000 2016  HillaryClinton   \n",
       "2556  Tue Jul 26 02:27:48 +0000 2016  HillaryClinton   \n",
       "2557  Tue Jul 26 02:26:28 +0000 2016  HillaryClinton   \n",
       "2558  Tue Jul 26 02:21:30 +0000 2016  HillaryClinton   \n",
       "2559  Tue Jul 26 02:20:08 +0000 2016  HillaryClinton   \n",
       "2560  Tue Jul 26 02:19:26 +0000 2016  HillaryClinton   \n",
       "2561  Tue Jul 26 02:16:18 +0000 2016  HillaryClinton   \n",
       "2562  Tue Jul 26 02:16:01 +0000 2016  HillaryClinton   \n",
       "2563  Tue Jul 26 02:15:11 +0000 2016  HillaryClinton   \n",
       "2564  Tue Jul 26 02:14:14 +0000 2016  HillaryClinton   \n",
       "2565  Tue Jul 26 02:12:21 +0000 2016  HillaryClinton   \n",
       "2566  Tue Jul 26 02:10:21 +0000 2016  HillaryClinton   \n",
       "\n",
       "                       mined_at  retweet_count  \\\n",
       "0    2018-01-20 02:08:40.529365          16059   \n",
       "1    2018-01-20 02:08:40.529391          23021   \n",
       "2    2018-01-20 02:08:40.529402           8990   \n",
       "3    2018-01-20 02:08:40.529413          59635   \n",
       "4    2018-01-20 02:08:40.529421            320   \n",
       "5    2018-01-20 02:08:40.529430           8529   \n",
       "6    2018-01-20 02:08:40.529438          14714   \n",
       "7    2018-01-20 02:08:40.529447          20666   \n",
       "8    2018-01-20 02:08:40.529454           3153   \n",
       "9    2018-01-20 02:08:40.529462           2478   \n",
       "10   2018-01-20 02:08:40.529470           1633   \n",
       "11   2018-01-20 02:08:40.529478           1260   \n",
       "12   2018-01-20 02:08:40.529485           1426   \n",
       "13   2018-01-20 02:08:40.529493           1355   \n",
       "14   2018-01-20 02:08:40.529500           1516   \n",
       "15   2018-01-20 02:08:40.529507           1869   \n",
       "16   2018-01-20 02:08:40.529514          11655   \n",
       "17   2018-01-20 02:08:40.529522          17938   \n",
       "18   2018-01-20 02:08:40.529529           7047   \n",
       "19   2018-01-20 02:08:40.529537           1431   \n",
       "20   2018-01-20 02:08:40.529544           3349   \n",
       "21   2018-01-20 02:08:40.529552           4418   \n",
       "22   2018-01-20 02:08:40.529559           1956   \n",
       "23   2018-01-20 02:08:40.529566           8415   \n",
       "24   2018-01-20 02:08:40.529573            591   \n",
       "25   2018-01-20 02:08:40.529580          12958   \n",
       "26   2018-01-20 02:08:40.529589          86064   \n",
       "27   2018-01-20 02:08:40.529596           5023   \n",
       "28   2018-01-20 02:08:40.529604           3121   \n",
       "29   2018-01-20 02:08:40.529610           4925   \n",
       "...                         ...            ...   \n",
       "2537 2018-01-20 02:08:49.063364           2342   \n",
       "2538 2018-01-20 02:08:49.063371           4968   \n",
       "2539 2018-01-20 02:08:49.063378           2587   \n",
       "2540 2018-01-20 02:08:49.063385           2667   \n",
       "2541 2018-01-20 02:08:49.063392           2711   \n",
       "2542 2018-01-20 02:08:49.063399           4911   \n",
       "2543 2018-01-20 02:08:49.063406           2031   \n",
       "2544 2018-01-20 02:08:49.063413            723   \n",
       "2545 2018-01-20 02:08:49.063420           2171   \n",
       "2546 2018-01-20 02:08:49.063427           3417   \n",
       "2547 2018-01-20 02:08:49.063434           1638   \n",
       "2548 2018-01-20 02:08:49.063441           2390   \n",
       "2549 2018-01-20 02:08:49.063447           1878   \n",
       "2550 2018-01-20 02:08:49.063455           1499   \n",
       "2551 2018-01-20 02:08:49.063462           2381   \n",
       "2552 2018-01-20 02:08:49.063469           3570   \n",
       "2553 2018-01-20 02:08:49.063476           2691   \n",
       "2554 2018-01-20 02:08:49.063482           2648   \n",
       "2555 2018-01-20 02:08:49.063489           1600   \n",
       "2556 2018-01-20 02:08:49.063497            454   \n",
       "2557 2018-01-20 02:08:49.063504           3971   \n",
       "2558 2018-01-20 02:08:49.063511           2597   \n",
       "2559 2018-01-20 02:08:49.063519           5081   \n",
       "2560 2018-01-20 02:08:49.063526           4801   \n",
       "2561 2018-01-20 02:08:49.063533           2552   \n",
       "2562 2018-01-20 02:08:49.063541           1893   \n",
       "2563 2018-01-20 02:08:49.063547           2219   \n",
       "2564 2018-01-20 02:08:49.063555           1496   \n",
       "2565 2018-01-20 02:08:49.063562           3985   \n",
       "2566 2018-01-20 02:08:49.063569           2453   \n",
       "\n",
       "                                                   text            tweet_id  \n",
       "0     I’m so heartened by all of you. Onward! https:...  954430425321046016  \n",
       "1     These words from Dr. King also come to mind to...  953005910930153472  \n",
       "2     Beautifully said, @BerniceKing. An important m...  952958227825782784  \n",
       "3     The anniversary of the devastating earthquake ...  951895239140298752  \n",
       "4     @NancyEMcFadden Nancy has a record of beating ...  951651923328987136  \n",
       "5     Families across America had to start 2018 worr...  948244463138328577  \n",
       "6     Time to bring CHIP to the Senate floor as prom...  948244159986651136  \n",
       "7     The Iranian people, especially the young, are ...  947313751992274944  \n",
       "8     Thank you to everyone who has donated to Onwar...  944279653883228160  \n",
       "9     Along with @IndivisibleTeam, @ColorOfChange, @...  944279421065814016  \n",
       "10    And with the help of @collectivepac, 23 Africa...  944279114172850177  \n",
       "11    More than 400 students and leaders met last mo...  944278916621066240  \n",
       "12    The team at @latinovictoryus is working to ele...  944278786874527744  \n",
       "13    At @alliance4youth, young people are using loc...  944278119237681152  \n",
       "14    450 brand-new civic leaders and activists atte...  944277880028237826  \n",
       "15    The organizers at @iVoteFund worked with partn...  944277660087324674  \n",
       "16    Onward Together is ending 2017 by supporting s...  944277382684463105  \n",
       "17    Something productive to do with your outrage t...  943569489664278533  \n",
       "18    I guest-edited this month’s issue of @TeenVogu...  943303660540452870  \n",
       "19    A little girl power in Pasadena...\\nhttps://t....  943253960139460611  \n",
       "20    Some photos from the book tour. I met so many ...  942103788890021888  \n",
       "21    Returning home after the final week of the boo...  941863582710620160  \n",
       "22    Thank you to the @lapromisefund &amp; @msjwill...  941786571837181953  \n",
       "23    Today is the final day to sign up for 2018 hea...  941726067638681600  \n",
       "24    @ELaffGarb @DHochsprung @ELaffGarb, thinking o...  941390586845597696  \n",
       "25      Yes!\\nElections matter. https://t.co/xU8dpew1Cn  940812691924496385  \n",
       "26    Tonight, Alabama voters elected a senator who'...  940786378069049344  \n",
       "27    Mayor Ed Lee’s death is a terrible loss for th...  940751455782391808  \n",
       "28    If you don't live in an area that could be aff...  939291618250842112  \n",
       "29    Thinking about all affected &amp; those who co...  939291298678362113  \n",
       "...                                                 ...                 ...  \n",
       "2537  \"I served with her in the United States Senate...  757778054815047680  \n",
       "2538  \"While...Trump is busy insulting one group aft...  757777047523557376  \n",
       "2539  \"Donald Trump? Well, like most Republicans, he...  757776714273546241  \n",
       "2540  “Hillary Clinton will nominate justices to the...  757774948928720896  \n",
       "2541  \"Hillary...understands that if someone in this...  757774363458433024  \n",
       "2542  \"Hillary Clinton must become the next presiden...  757773990173806592  \n",
       "2543  \"We have come a long way in the last 7 1/2 yea...  757773551751598080  \n",
       "2544  Happening now: Watch @BernieSanders address th...  757771391093600256  \n",
       "2545  \"Trump’s entire campaign is just one more, lat...  757769901402681344  \n",
       "2546  Couldn’t agree more, @POTUS. https://t.co/hvsf...  757769136269320193  \n",
       "2547  “If you believe we are stronger together, then...  757768703521988610  \n",
       "2548  “We’re not going to be Donald Trump’s hate-fil...  757767949327400964  \n",
       "2549  \"When we turn on each other, we can’t unite to...  757767826648231936  \n",
       "2550  “That’s Donald Trump’s America—an America of f...  757767359843147776  \n",
       "2551  \"He even picked a vice president famous for tr...  757767223134093316  \n",
       "2552  \"Last week...Trump spoke for more than an hour...  757766649474912257  \n",
       "2553  \"What kind of a man cheats students, cheats in...  757766513013194752  \n",
       "2554  \"What kind of a man roots for an economic cras...  757766052428312576  \n",
       "2555  \"He preyed on...people who had fallen on hard ...  757765891908132864  \n",
       "2556  Watch @ElizabethForMA live at the #DemConventi...  757764326128283648  \n",
       "2557  \"Hillary Clinton has never quit on anything in...  757763989359173632  \n",
       "2558  \"We need to pour every last ounce of our passi...  757762738433191936  \n",
       "2559  \"Don’t let anyone ever tell you that this coun...  757762395787911168  \n",
       "2560  “Because of Hillary Clinton, my daughters…now ...  757762219300052992  \n",
       "2561  \"Hillary understands that the presidency is ab...  757761430477279232  \n",
       "2562  \"In this election, I’m with her!\" —@FLOTUS on ...  757761359035699200  \n",
       "2563  \"We don’t turn against each other—no, we liste...  757761152231346176  \n",
       "2564  \"Hillary Clinton has never quit on anything in...  757760912581419008  \n",
       "2565  \"When she didn’t win the nomination 8 years ag...  757760436842459137  \n",
       "2566  \"There is only one person...truly qualified to...  757759935136600064  \n",
       "\n",
       "[2567 rows x 6 columns]"
      ]
     },
     "execution_count": 92,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# A:\n",
    "pd.DataFrame(hillary)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "##  Create the training data\n",
    "\n",
    "---\n",
    "\n",
    "\"Mined\" data from the Twitter API.  \n",
    "\n",
    "1. Mine Trump tweets\n",
    "- Create a tweet DataFrame\n",
    "- Mine Hillary tweets\n",
    "- Append the results to our DataFrame"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 93,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:57:36.527573Z",
     "start_time": "2018-01-19T01:57:29.980850Z"
    },
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# A:\n",
    "miner = TweetMiner(api, result_limit=200)\n",
    "trump_tweets = miner.mine_user_tweets(\"realDonaldTrump\", max_pages=14)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 94,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:57:36.545200Z",
     "start_time": "2018-01-19T01:57:36.529303Z"
    },
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "trump_df = pd.DataFrame(trump_tweets)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 95,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:57:36.650253Z",
     "start_time": "2018-01-19T01:57:36.547541Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>created_at</th>\n",
       "      <th>handle</th>\n",
       "      <th>mined_at</th>\n",
       "      <th>retweet_count</th>\n",
       "      <th>text</th>\n",
       "      <th>tweet_id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Sat Jan 20 02:28:56 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242658</td>\n",
       "      <td>20046</td>\n",
       "      <td>Not looking good for our great Military or Saf...</td>\n",
       "      <td>954541219970977793</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Fri Jan 19 22:17:53 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242677</td>\n",
       "      <td>10552</td>\n",
       "      <td>Excellent preliminary meeting in Oval with @Se...</td>\n",
       "      <td>954478044487520257</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Fri Jan 19 20:53:17 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242683</td>\n",
       "      <td>21828</td>\n",
       "      <td>Just signed 702 Bill to reauthorize foreign in...</td>\n",
       "      <td>954456754137501697</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Fri Jan 19 18:39:50 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242687</td>\n",
       "      <td>18452</td>\n",
       "      <td>Today, I was honored and proud to address the ...</td>\n",
       "      <td>954423170299199488</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Fri Jan 19 16:28:29 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242692</td>\n",
       "      <td>13149</td>\n",
       "      <td>“Shutting down the government is a very seriou...</td>\n",
       "      <td>954390114968498176</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Fri Jan 19 16:14:05 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242698</td>\n",
       "      <td>7464</td>\n",
       "      <td>.@WhiteHouse Briefing with Director Marc Short...</td>\n",
       "      <td>954386490842378241</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Fri Jan 19 12:04:47 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242702</td>\n",
       "      <td>24203</td>\n",
       "      <td>Government Funding Bill past last night in the...</td>\n",
       "      <td>954323750949982208</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Thu Jan 18 23:39:53 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242707</td>\n",
       "      <td>19717</td>\n",
       "      <td>House of Representatives needs to pass Governm...</td>\n",
       "      <td>954136290768846850</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Thu Jan 18 21:04:36 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242712</td>\n",
       "      <td>24458</td>\n",
       "      <td>AMERICA will once again be a NATION that think...</td>\n",
       "      <td>954097213608570880</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Thu Jan 18 20:45:33 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242717</td>\n",
       "      <td>14567</td>\n",
       "      <td>Departing Pittsburgh now, where it was my grea...</td>\n",
       "      <td>954092417250222082</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>Thu Jan 18 13:49:11 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242721</td>\n",
       "      <td>21117</td>\n",
       "      <td>A government shutdown will be devastating to o...</td>\n",
       "      <td>953987636057821184</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Thu Jan 18 13:37:24 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242726</td>\n",
       "      <td>11490</td>\n",
       "      <td>CHIP should be part of a long term solution, n...</td>\n",
       "      <td>953984671674662912</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Thu Jan 18 13:16:26 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242731</td>\n",
       "      <td>27313</td>\n",
       "      <td>We need the Wall for the safety and security o...</td>\n",
       "      <td>953979393180950528</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Thu Jan 18 12:53:17 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242735</td>\n",
       "      <td>16678</td>\n",
       "      <td>Will be going to Pennsylvania today in order t...</td>\n",
       "      <td>953973568035086336</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Thu Jan 18 11:25:03 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242740</td>\n",
       "      <td>27243</td>\n",
       "      <td>....The Wall will be paid for, directly or ind...</td>\n",
       "      <td>953951365532876800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Thu Jan 18 11:15:25 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242744</td>\n",
       "      <td>20819</td>\n",
       "      <td>The Wall is the Wall, it has never changed or ...</td>\n",
       "      <td>953948941674078208</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Thu Jan 18 01:11:26 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242749</td>\n",
       "      <td>39537</td>\n",
       "      <td>ISIS is in retreat, our economy is booming, in...</td>\n",
       "      <td>953796944564031489</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Thu Jan 18 01:05:46 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242755</td>\n",
       "      <td>22196</td>\n",
       "      <td>Despite some very corrupt and dishonest media ...</td>\n",
       "      <td>953795518592843777</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>Thu Jan 18 01:00:05 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242759</td>\n",
       "      <td>41941</td>\n",
       "      <td>And the FAKE NEWS winners are...\\nhttps://t.co...</td>\n",
       "      <td>953794085751574534</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>Wed Jan 17 23:36:44 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242764</td>\n",
       "      <td>15375</td>\n",
       "      <td>Main Street is BACK! Strongest Holiday Sales b...</td>\n",
       "      <td>953773110553186312</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Wed Jan 17 23:32:58 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242768</td>\n",
       "      <td>24342</td>\n",
       "      <td>During the campaign, I promised to MAKE AMERIC...</td>\n",
       "      <td>953772162665590787</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>Wed Jan 17 23:28:30 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242773</td>\n",
       "      <td>23990</td>\n",
       "      <td>I promised that my policies would allow compan...</td>\n",
       "      <td>953771038114045954</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>Wed Jan 17 23:19:02 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242778</td>\n",
       "      <td>15214</td>\n",
       "      <td>Today, we witnessed an incredible moment in hi...</td>\n",
       "      <td>953768657221451776</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>Wed Jan 17 13:04:46 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242782</td>\n",
       "      <td>6647</td>\n",
       "      <td>Eric Trump on @foxandfriends  now!</td>\n",
       "      <td>953614071336701952</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>Tue Jan 16 23:20:10 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242787</td>\n",
       "      <td>18911</td>\n",
       "      <td>....we need to keep America safe, including mo...</td>\n",
       "      <td>953406553083777029</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>Tue Jan 16 23:19:39 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242791</td>\n",
       "      <td>25689</td>\n",
       "      <td>New report from DOJ &amp;amp; DHS shows that nearl...</td>\n",
       "      <td>953406423177859073</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>Tue Jan 16 20:17:39 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242797</td>\n",
       "      <td>9877</td>\n",
       "      <td>Today, it was my honor to welcome President Nu...</td>\n",
       "      <td>953360619834691585</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>Tue Jan 16 19:43:32 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242801</td>\n",
       "      <td>19480</td>\n",
       "      <td>“President Donald J. Trump Proclaims January 1...</td>\n",
       "      <td>953352036309000194</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>Tue Jan 16 14:30:00 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242806</td>\n",
       "      <td>28453</td>\n",
       "      <td>Unemployment for Black Americans is the lowest...</td>\n",
       "      <td>953273134655987716</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>Tue Jan 16 14:24:40 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:09.242811</td>\n",
       "      <td>16622</td>\n",
       "      <td>“90% of Trump 2017 news coverage was negative”...</td>\n",
       "      <td>953271789790138368</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2449</th>\n",
       "      <td>Mon Dec 12 22:25:52 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183480</td>\n",
       "      <td>7588</td>\n",
       "      <td>#ThankYouTour2016 \\n\\nTue: West Allis, WI. \\n\\...</td>\n",
       "      <td>808437742904418304</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2450</th>\n",
       "      <td>Mon Dec 12 13:26:13 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183485</td>\n",
       "      <td>15736</td>\n",
       "      <td>The F-35 program and cost is out of control. B...</td>\n",
       "      <td>808301935728230404</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2451</th>\n",
       "      <td>Mon Dec 12 13:21:20 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183489</td>\n",
       "      <td>15231</td>\n",
       "      <td>Unless you catch \"hackers\" in the act, it is v...</td>\n",
       "      <td>808300706914594816</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2452</th>\n",
       "      <td>Mon Dec 12 13:17:54 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183494</td>\n",
       "      <td>32774</td>\n",
       "      <td>Can you imagine if the election results were t...</td>\n",
       "      <td>808299841147248640</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2453</th>\n",
       "      <td>Mon Dec 12 01:02:14 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183499</td>\n",
       "      <td>19173</td>\n",
       "      <td>Just watched @NBCNightlyNews - So biased, inac...</td>\n",
       "      <td>808114703922843649</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2454</th>\n",
       "      <td>Mon Dec 12 00:32:28 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183504</td>\n",
       "      <td>5229</td>\n",
       "      <td>Will be interviewed on @FoxNews at 10:00 P.M. ...</td>\n",
       "      <td>808107215492091904</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2455</th>\n",
       "      <td>Sun Dec 11 15:29:10 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183508</td>\n",
       "      <td>11895</td>\n",
       "      <td>Whether I choose him or not for \"State\"- Rex T...</td>\n",
       "      <td>807970490635743237</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2456</th>\n",
       "      <td>Sun Dec 11 13:51:47 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183513</td>\n",
       "      <td>9562</td>\n",
       "      <td>I spent Friday campaigning with John Kennedy, ...</td>\n",
       "      <td>807945982633709570</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2457</th>\n",
       "      <td>Sun Dec 11 13:12:06 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183518</td>\n",
       "      <td>12634</td>\n",
       "      <td>Being at the Army - Navy Game was fantastic. T...</td>\n",
       "      <td>807935995316408322</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2458</th>\n",
       "      <td>Sun Dec 11 12:56:18 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183523</td>\n",
       "      <td>5458</td>\n",
       "      <td>I will be interviewed today on Fox News Sunday...</td>\n",
       "      <td>807932020236124160</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2459</th>\n",
       "      <td>Sat Dec 10 19:09:13 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183527</td>\n",
       "      <td>7021</td>\n",
       "      <td>October 2015 - thanks Chris Wallace @FoxNewsSu...</td>\n",
       "      <td>807663477322027008</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2460</th>\n",
       "      <td>Sat Dec 10 14:14:23 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183532</td>\n",
       "      <td>11898</td>\n",
       "      <td>A very interesting read. Unfortunately, so muc...</td>\n",
       "      <td>807589280071684096</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2461</th>\n",
       "      <td>Sat Dec 10 14:11:49 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183536</td>\n",
       "      <td>24118</td>\n",
       "      <td>Reports by @CNN that I will be working on The ...</td>\n",
       "      <td>807588632877998081</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2462</th>\n",
       "      <td>Sat Dec 10 12:38:24 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183550</td>\n",
       "      <td>17936</td>\n",
       "      <td>As a show of support for our Armed Forces, I w...</td>\n",
       "      <td>807565127021109252</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2463</th>\n",
       "      <td>Sat Dec 10 11:27:22 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183554</td>\n",
       "      <td>10864</td>\n",
       "      <td>I have NOTHING to do with The Apprentice excep...</td>\n",
       "      <td>807547249681166336</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2464</th>\n",
       "      <td>Sat Dec 10 11:19:24 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183558</td>\n",
       "      <td>6927</td>\n",
       "      <td>.@RudyGiuliani, one of the finest people I kno...</td>\n",
       "      <td>807545243608420352</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2465</th>\n",
       "      <td>Sat Dec 10 03:30:50 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183562</td>\n",
       "      <td>8855</td>\n",
       "      <td>Thank you Michigan. We are going to bring back...</td>\n",
       "      <td>807427326522884096</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2466</th>\n",
       "      <td>Fri Dec 09 22:13:21 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183566</td>\n",
       "      <td>8802</td>\n",
       "      <td>Thank you Louisiana! Get out &amp;amp; vote for Jo...</td>\n",
       "      <td>807347429062443009</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2467</th>\n",
       "      <td>Fri Dec 09 19:42:30 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183571</td>\n",
       "      <td>5197</td>\n",
       "      <td>Join me live in Louisiana! Tomorrow, we need y...</td>\n",
       "      <td>807309464705630208</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2468</th>\n",
       "      <td>Fri Dec 09 03:02:04 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183574</td>\n",
       "      <td>9120</td>\n",
       "      <td>THANK YOU IOWA!\\n#ThankYouTour2016 https://t.c...</td>\n",
       "      <td>807057700857188355</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2469</th>\n",
       "      <td>Thu Dec 08 23:12:11 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183579</td>\n",
       "      <td>5756</td>\n",
       "      <td>Join me tomorrow! #MAGA \\n10am- Baton Rouge, L...</td>\n",
       "      <td>806999846674698240</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2470</th>\n",
       "      <td>Thu Dec 08 22:55:24 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183583</td>\n",
       "      <td>3949</td>\n",
       "      <td>On my way to Des Moines, Iowa- will see you so...</td>\n",
       "      <td>806995622117122048</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2471</th>\n",
       "      <td>Thu Dec 08 21:15:52 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183587</td>\n",
       "      <td>19466</td>\n",
       "      <td>Today we lost a great pioneer of air and space...</td>\n",
       "      <td>806970576359325696</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2472</th>\n",
       "      <td>Thu Dec 08 01:56:40 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183591</td>\n",
       "      <td>13612</td>\n",
       "      <td>If United Steelworkers 1999 was any good, they...</td>\n",
       "      <td>806678853305384960</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2473</th>\n",
       "      <td>Thu Dec 08 00:41:48 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183595</td>\n",
       "      <td>12395</td>\n",
       "      <td>Chuck Jones, who is President of United Steelw...</td>\n",
       "      <td>806660011904614408</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2474</th>\n",
       "      <td>Wed Dec 07 19:37:32 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183599</td>\n",
       "      <td>6145</td>\n",
       "      <td>Join me tomorrow in Des Moines, Iowa with Vice...</td>\n",
       "      <td>806583438748815361</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2475</th>\n",
       "      <td>Wed Dec 07 18:38:00 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183603</td>\n",
       "      <td>17881</td>\n",
       "      <td>We pause today to remember the 2,403 American ...</td>\n",
       "      <td>806568460620857349</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2476</th>\n",
       "      <td>Wed Dec 07 12:18:56 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183607</td>\n",
       "      <td>5173</td>\n",
       "      <td>I will be interviewed on the @TODAYshow at 7:3...</td>\n",
       "      <td>806473064703725568</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2477</th>\n",
       "      <td>Wed Dec 07 03:33:20 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183612</td>\n",
       "      <td>7447</td>\n",
       "      <td>A great night in Fayetteville, North Carolina....</td>\n",
       "      <td>806340792247795715</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2478</th>\n",
       "      <td>Tue Dec 06 21:17:45 +0000 2016</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 02:09:15.183616</td>\n",
       "      <td>13708</td>\n",
       "      <td>Departing New York with General James 'Mad Dog...</td>\n",
       "      <td>806246271405162500</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2479 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                          created_at           handle  \\\n",
       "0     Sat Jan 20 02:28:56 +0000 2018  realDonaldTrump   \n",
       "1     Fri Jan 19 22:17:53 +0000 2018  realDonaldTrump   \n",
       "2     Fri Jan 19 20:53:17 +0000 2018  realDonaldTrump   \n",
       "3     Fri Jan 19 18:39:50 +0000 2018  realDonaldTrump   \n",
       "4     Fri Jan 19 16:28:29 +0000 2018  realDonaldTrump   \n",
       "5     Fri Jan 19 16:14:05 +0000 2018  realDonaldTrump   \n",
       "6     Fri Jan 19 12:04:47 +0000 2018  realDonaldTrump   \n",
       "7     Thu Jan 18 23:39:53 +0000 2018  realDonaldTrump   \n",
       "8     Thu Jan 18 21:04:36 +0000 2018  realDonaldTrump   \n",
       "9     Thu Jan 18 20:45:33 +0000 2018  realDonaldTrump   \n",
       "10    Thu Jan 18 13:49:11 +0000 2018  realDonaldTrump   \n",
       "11    Thu Jan 18 13:37:24 +0000 2018  realDonaldTrump   \n",
       "12    Thu Jan 18 13:16:26 +0000 2018  realDonaldTrump   \n",
       "13    Thu Jan 18 12:53:17 +0000 2018  realDonaldTrump   \n",
       "14    Thu Jan 18 11:25:03 +0000 2018  realDonaldTrump   \n",
       "15    Thu Jan 18 11:15:25 +0000 2018  realDonaldTrump   \n",
       "16    Thu Jan 18 01:11:26 +0000 2018  realDonaldTrump   \n",
       "17    Thu Jan 18 01:05:46 +0000 2018  realDonaldTrump   \n",
       "18    Thu Jan 18 01:00:05 +0000 2018  realDonaldTrump   \n",
       "19    Wed Jan 17 23:36:44 +0000 2018  realDonaldTrump   \n",
       "20    Wed Jan 17 23:32:58 +0000 2018  realDonaldTrump   \n",
       "21    Wed Jan 17 23:28:30 +0000 2018  realDonaldTrump   \n",
       "22    Wed Jan 17 23:19:02 +0000 2018  realDonaldTrump   \n",
       "23    Wed Jan 17 13:04:46 +0000 2018  realDonaldTrump   \n",
       "24    Tue Jan 16 23:20:10 +0000 2018  realDonaldTrump   \n",
       "25    Tue Jan 16 23:19:39 +0000 2018  realDonaldTrump   \n",
       "26    Tue Jan 16 20:17:39 +0000 2018  realDonaldTrump   \n",
       "27    Tue Jan 16 19:43:32 +0000 2018  realDonaldTrump   \n",
       "28    Tue Jan 16 14:30:00 +0000 2018  realDonaldTrump   \n",
       "29    Tue Jan 16 14:24:40 +0000 2018  realDonaldTrump   \n",
       "...                              ...              ...   \n",
       "2449  Mon Dec 12 22:25:52 +0000 2016  realDonaldTrump   \n",
       "2450  Mon Dec 12 13:26:13 +0000 2016  realDonaldTrump   \n",
       "2451  Mon Dec 12 13:21:20 +0000 2016  realDonaldTrump   \n",
       "2452  Mon Dec 12 13:17:54 +0000 2016  realDonaldTrump   \n",
       "2453  Mon Dec 12 01:02:14 +0000 2016  realDonaldTrump   \n",
       "2454  Mon Dec 12 00:32:28 +0000 2016  realDonaldTrump   \n",
       "2455  Sun Dec 11 15:29:10 +0000 2016  realDonaldTrump   \n",
       "2456  Sun Dec 11 13:51:47 +0000 2016  realDonaldTrump   \n",
       "2457  Sun Dec 11 13:12:06 +0000 2016  realDonaldTrump   \n",
       "2458  Sun Dec 11 12:56:18 +0000 2016  realDonaldTrump   \n",
       "2459  Sat Dec 10 19:09:13 +0000 2016  realDonaldTrump   \n",
       "2460  Sat Dec 10 14:14:23 +0000 2016  realDonaldTrump   \n",
       "2461  Sat Dec 10 14:11:49 +0000 2016  realDonaldTrump   \n",
       "2462  Sat Dec 10 12:38:24 +0000 2016  realDonaldTrump   \n",
       "2463  Sat Dec 10 11:27:22 +0000 2016  realDonaldTrump   \n",
       "2464  Sat Dec 10 11:19:24 +0000 2016  realDonaldTrump   \n",
       "2465  Sat Dec 10 03:30:50 +0000 2016  realDonaldTrump   \n",
       "2466  Fri Dec 09 22:13:21 +0000 2016  realDonaldTrump   \n",
       "2467  Fri Dec 09 19:42:30 +0000 2016  realDonaldTrump   \n",
       "2468  Fri Dec 09 03:02:04 +0000 2016  realDonaldTrump   \n",
       "2469  Thu Dec 08 23:12:11 +0000 2016  realDonaldTrump   \n",
       "2470  Thu Dec 08 22:55:24 +0000 2016  realDonaldTrump   \n",
       "2471  Thu Dec 08 21:15:52 +0000 2016  realDonaldTrump   \n",
       "2472  Thu Dec 08 01:56:40 +0000 2016  realDonaldTrump   \n",
       "2473  Thu Dec 08 00:41:48 +0000 2016  realDonaldTrump   \n",
       "2474  Wed Dec 07 19:37:32 +0000 2016  realDonaldTrump   \n",
       "2475  Wed Dec 07 18:38:00 +0000 2016  realDonaldTrump   \n",
       "2476  Wed Dec 07 12:18:56 +0000 2016  realDonaldTrump   \n",
       "2477  Wed Dec 07 03:33:20 +0000 2016  realDonaldTrump   \n",
       "2478  Tue Dec 06 21:17:45 +0000 2016  realDonaldTrump   \n",
       "\n",
       "                       mined_at  retweet_count  \\\n",
       "0    2018-01-20 02:09:09.242658          20046   \n",
       "1    2018-01-20 02:09:09.242677          10552   \n",
       "2    2018-01-20 02:09:09.242683          21828   \n",
       "3    2018-01-20 02:09:09.242687          18452   \n",
       "4    2018-01-20 02:09:09.242692          13149   \n",
       "5    2018-01-20 02:09:09.242698           7464   \n",
       "6    2018-01-20 02:09:09.242702          24203   \n",
       "7    2018-01-20 02:09:09.242707          19717   \n",
       "8    2018-01-20 02:09:09.242712          24458   \n",
       "9    2018-01-20 02:09:09.242717          14567   \n",
       "10   2018-01-20 02:09:09.242721          21117   \n",
       "11   2018-01-20 02:09:09.242726          11490   \n",
       "12   2018-01-20 02:09:09.242731          27313   \n",
       "13   2018-01-20 02:09:09.242735          16678   \n",
       "14   2018-01-20 02:09:09.242740          27243   \n",
       "15   2018-01-20 02:09:09.242744          20819   \n",
       "16   2018-01-20 02:09:09.242749          39537   \n",
       "17   2018-01-20 02:09:09.242755          22196   \n",
       "18   2018-01-20 02:09:09.242759          41941   \n",
       "19   2018-01-20 02:09:09.242764          15375   \n",
       "20   2018-01-20 02:09:09.242768          24342   \n",
       "21   2018-01-20 02:09:09.242773          23990   \n",
       "22   2018-01-20 02:09:09.242778          15214   \n",
       "23   2018-01-20 02:09:09.242782           6647   \n",
       "24   2018-01-20 02:09:09.242787          18911   \n",
       "25   2018-01-20 02:09:09.242791          25689   \n",
       "26   2018-01-20 02:09:09.242797           9877   \n",
       "27   2018-01-20 02:09:09.242801          19480   \n",
       "28   2018-01-20 02:09:09.242806          28453   \n",
       "29   2018-01-20 02:09:09.242811          16622   \n",
       "...                         ...            ...   \n",
       "2449 2018-01-20 02:09:15.183480           7588   \n",
       "2450 2018-01-20 02:09:15.183485          15736   \n",
       "2451 2018-01-20 02:09:15.183489          15231   \n",
       "2452 2018-01-20 02:09:15.183494          32774   \n",
       "2453 2018-01-20 02:09:15.183499          19173   \n",
       "2454 2018-01-20 02:09:15.183504           5229   \n",
       "2455 2018-01-20 02:09:15.183508          11895   \n",
       "2456 2018-01-20 02:09:15.183513           9562   \n",
       "2457 2018-01-20 02:09:15.183518          12634   \n",
       "2458 2018-01-20 02:09:15.183523           5458   \n",
       "2459 2018-01-20 02:09:15.183527           7021   \n",
       "2460 2018-01-20 02:09:15.183532          11898   \n",
       "2461 2018-01-20 02:09:15.183536          24118   \n",
       "2462 2018-01-20 02:09:15.183550          17936   \n",
       "2463 2018-01-20 02:09:15.183554          10864   \n",
       "2464 2018-01-20 02:09:15.183558           6927   \n",
       "2465 2018-01-20 02:09:15.183562           8855   \n",
       "2466 2018-01-20 02:09:15.183566           8802   \n",
       "2467 2018-01-20 02:09:15.183571           5197   \n",
       "2468 2018-01-20 02:09:15.183574           9120   \n",
       "2469 2018-01-20 02:09:15.183579           5756   \n",
       "2470 2018-01-20 02:09:15.183583           3949   \n",
       "2471 2018-01-20 02:09:15.183587          19466   \n",
       "2472 2018-01-20 02:09:15.183591          13612   \n",
       "2473 2018-01-20 02:09:15.183595          12395   \n",
       "2474 2018-01-20 02:09:15.183599           6145   \n",
       "2475 2018-01-20 02:09:15.183603          17881   \n",
       "2476 2018-01-20 02:09:15.183607           5173   \n",
       "2477 2018-01-20 02:09:15.183612           7447   \n",
       "2478 2018-01-20 02:09:15.183616          13708   \n",
       "\n",
       "                                                   text            tweet_id  \n",
       "0     Not looking good for our great Military or Saf...  954541219970977793  \n",
       "1     Excellent preliminary meeting in Oval with @Se...  954478044487520257  \n",
       "2     Just signed 702 Bill to reauthorize foreign in...  954456754137501697  \n",
       "3     Today, I was honored and proud to address the ...  954423170299199488  \n",
       "4     “Shutting down the government is a very seriou...  954390114968498176  \n",
       "5     .@WhiteHouse Briefing with Director Marc Short...  954386490842378241  \n",
       "6     Government Funding Bill past last night in the...  954323750949982208  \n",
       "7     House of Representatives needs to pass Governm...  954136290768846850  \n",
       "8     AMERICA will once again be a NATION that think...  954097213608570880  \n",
       "9     Departing Pittsburgh now, where it was my grea...  954092417250222082  \n",
       "10    A government shutdown will be devastating to o...  953987636057821184  \n",
       "11    CHIP should be part of a long term solution, n...  953984671674662912  \n",
       "12    We need the Wall for the safety and security o...  953979393180950528  \n",
       "13    Will be going to Pennsylvania today in order t...  953973568035086336  \n",
       "14    ....The Wall will be paid for, directly or ind...  953951365532876800  \n",
       "15    The Wall is the Wall, it has never changed or ...  953948941674078208  \n",
       "16    ISIS is in retreat, our economy is booming, in...  953796944564031489  \n",
       "17    Despite some very corrupt and dishonest media ...  953795518592843777  \n",
       "18    And the FAKE NEWS winners are...\\nhttps://t.co...  953794085751574534  \n",
       "19    Main Street is BACK! Strongest Holiday Sales b...  953773110553186312  \n",
       "20    During the campaign, I promised to MAKE AMERIC...  953772162665590787  \n",
       "21    I promised that my policies would allow compan...  953771038114045954  \n",
       "22    Today, we witnessed an incredible moment in hi...  953768657221451776  \n",
       "23                   Eric Trump on @foxandfriends  now!  953614071336701952  \n",
       "24    ....we need to keep America safe, including mo...  953406553083777029  \n",
       "25    New report from DOJ &amp; DHS shows that nearl...  953406423177859073  \n",
       "26    Today, it was my honor to welcome President Nu...  953360619834691585  \n",
       "27    “President Donald J. Trump Proclaims January 1...  953352036309000194  \n",
       "28    Unemployment for Black Americans is the lowest...  953273134655987716  \n",
       "29    “90% of Trump 2017 news coverage was negative”...  953271789790138368  \n",
       "...                                                 ...                 ...  \n",
       "2449  #ThankYouTour2016 \\n\\nTue: West Allis, WI. \\n\\...  808437742904418304  \n",
       "2450  The F-35 program and cost is out of control. B...  808301935728230404  \n",
       "2451  Unless you catch \"hackers\" in the act, it is v...  808300706914594816  \n",
       "2452  Can you imagine if the election results were t...  808299841147248640  \n",
       "2453  Just watched @NBCNightlyNews - So biased, inac...  808114703922843649  \n",
       "2454  Will be interviewed on @FoxNews at 10:00 P.M. ...  808107215492091904  \n",
       "2455  Whether I choose him or not for \"State\"- Rex T...  807970490635743237  \n",
       "2456  I spent Friday campaigning with John Kennedy, ...  807945982633709570  \n",
       "2457  Being at the Army - Navy Game was fantastic. T...  807935995316408322  \n",
       "2458  I will be interviewed today on Fox News Sunday...  807932020236124160  \n",
       "2459  October 2015 - thanks Chris Wallace @FoxNewsSu...  807663477322027008  \n",
       "2460  A very interesting read. Unfortunately, so muc...  807589280071684096  \n",
       "2461  Reports by @CNN that I will be working on The ...  807588632877998081  \n",
       "2462  As a show of support for our Armed Forces, I w...  807565127021109252  \n",
       "2463  I have NOTHING to do with The Apprentice excep...  807547249681166336  \n",
       "2464  .@RudyGiuliani, one of the finest people I kno...  807545243608420352  \n",
       "2465  Thank you Michigan. We are going to bring back...  807427326522884096  \n",
       "2466  Thank you Louisiana! Get out &amp; vote for Jo...  807347429062443009  \n",
       "2467  Join me live in Louisiana! Tomorrow, we need y...  807309464705630208  \n",
       "2468  THANK YOU IOWA!\\n#ThankYouTour2016 https://t.c...  807057700857188355  \n",
       "2469  Join me tomorrow! #MAGA \\n10am- Baton Rouge, L...  806999846674698240  \n",
       "2470  On my way to Des Moines, Iowa- will see you so...  806995622117122048  \n",
       "2471  Today we lost a great pioneer of air and space...  806970576359325696  \n",
       "2472  If United Steelworkers 1999 was any good, they...  806678853305384960  \n",
       "2473  Chuck Jones, who is President of United Steelw...  806660011904614408  \n",
       "2474  Join me tomorrow in Des Moines, Iowa with Vice...  806583438748815361  \n",
       "2475  We pause today to remember the 2,403 American ...  806568460620857349  \n",
       "2476  I will be interviewed on the @TODAYshow at 7:3...  806473064703725568  \n",
       "2477  A great night in Fayetteville, North Carolina....  806340792247795715  \n",
       "2478  Departing New York with General James 'Mad Dog...  806246271405162500  \n",
       "\n",
       "[2479 rows x 6 columns]"
      ]
     },
     "execution_count": 95,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "trump_df"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 96,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:57:36.658392Z",
     "start_time": "2018-01-19T01:57:36.652260Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(2479, 6)"
      ]
     },
     "execution_count": 96,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "trump_df.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 97,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:55:04.476627Z",
     "start_time": "2018-01-19T01:54:55.880491Z"
    },
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "hillary_tweets = miner.mine_user_tweets('HillaryClinton')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 98,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:57:43.251821Z",
     "start_time": "2018-01-19T01:57:43.236741Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(2567, 6)\n"
     ]
    }
   ],
   "source": [
    "hillary_df = pd.DataFrame(hillary_tweets)\n",
    "print hillary_df.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 99,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:57:44.350937Z",
     "start_time": "2018-01-19T01:57:44.340234Z"
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(5046, 6)"
      ]
     },
     "execution_count": 99,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tweets = pd.concat([trump_df, hillary_df], axis=0)\n",
    "tweets.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Any interesting ngrams going on with Trump or Hillary?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 100,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:57:47.168556Z",
     "start_time": "2018-01-19T01:57:46.953157Z"
    },
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[(u'fake news', 162),\n",
       " (u'america great', 79),\n",
       " (u'tax cuts', 72),\n",
       " (u'make america', 65),\n",
       " (u'united states', 63),\n",
       " (u'make america great', 59),\n",
       " (u'north korea', 50),\n",
       " (u'news media', 44),\n",
       " (u'white house', 43),\n",
       " (u'great honor', 43),\n",
       " (u'fake news media', 42),\n",
       " (u'stock market', 40),\n",
       " (u'tax cut', 34),\n",
       " (u'working hard', 32),\n",
       " (u'usa https', 31),\n",
       " (u'hillary clinton', 30),\n",
       " (u'puerto rico', 27),\n",
       " (u'prime minister', 27),\n",
       " (u'american people', 27),\n",
       " (u'jobs jobs', 26)]"
      ]
     },
     "execution_count": 100,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from sklearn.feature_extraction.text import TfidfVectorizer\n",
    "from collections import Counter\n",
    "\n",
    "# We can use the TfidfVectorizer to find ngrams for us\n",
    "vect = TfidfVectorizer(ngram_range=(2,5), stop_words='english')\n",
    "\n",
    "# Pulls all of trumps tweet text's into one giant string\n",
    "summaries = \"\".join(trump_df['text'])\n",
    "ngrams_summaries = vect.build_analyzer()(summaries)\n",
    "\n",
    "Counter(ngrams_summaries).most_common(20)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Fake news....figures"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 101,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:57:48.598233Z",
     "start_time": "2018-01-19T01:57:48.404905Z"
    },
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[(u'donald trump', 218),\n",
       " (u'hillary https', 101),\n",
       " (u'https ttgeqxnqym', 88),\n",
       " (u'hillary clinton', 69),\n",
       " (u'vote https', 57),\n",
       " (u'make sure', 52),\n",
       " (u'trump https', 48),\n",
       " (u'ttgeqxnqym https', 47),\n",
       " (u'https ttgeqxnqym https', 47),\n",
       " (u'debatenight https', 47),\n",
       " (u'potus https', 45),\n",
       " (u'https 3tkj4h68kz', 44),\n",
       " (u'president https', 39),\n",
       " (u'https 3tkj4h68kz https', 32),\n",
       " (u'3tkj4h68kz https', 32),\n",
       " (u'united states', 31),\n",
       " (u'flotus https', 30),\n",
       " (u've got', 30),\n",
       " (u'commander chief', 29),\n",
       " (u'donald trump https', 28)]"
      ]
     },
     "execution_count": 101,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "vect = TfidfVectorizer(ngram_range=(2,5), stop_words='english')\n",
    "\n",
    "summaries = \"\".join(hillary_df['text'])\n",
    "ngrams_summaries = vect.build_analyzer()(summaries)\n",
    "\n",
    "Counter(ngrams_summaries).most_common(20)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Processing the tweets and building a model\n",
    "\n",
    "---\n",
    "\n",
    "To do classfication I will need to convert the tweets into a set of features.\n",
    "\n",
    "**I'll do this by:**\n",
    "- Vectorizing input text data.\n",
    "- Intializing a model.\n",
    "- Grid Searching for optimal hyperparameters.\n",
    "- Training and fitting optimized model.\n",
    "- Evaluating the performance of the model."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 102,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:57:53.966413Z",
     "start_time": "2018-01-19T01:57:51.752413Z"
    },
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "#cleaning text data using textacy\n",
    "from textacy.preprocess import preprocess_text\n",
    "\n",
    "tweet_text = tweets['text'].values\n",
    "clean_text = [preprocess_text(x, fix_unicode=True, lowercase=True, no_urls=True, no_emails=True, no_phone_numbers=True, no_currency_symbols=True,\n",
    "                              no_punct=True, no_accents=True)\n",
    "              for x in tweet_text]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 103,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:57:53.974626Z",
     "start_time": "2018-01-19T01:57:53.968069Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[ u'Excellent preliminary meeting in Oval with @SenSchumer - working on solutions for Security and our great Military together with @SenateMajLdr McConnell and @SpeakerRyan. Making progress - four week extension would be best!'\n",
      " u'Just signed 702 Bill to reauthorize foreign intelligence collection. This is NOT the same FISA law that was so wrongly abused during the election. I will always do the right thing for our country and put the safety of the American people first!'\n",
      " u'Today, I was honored and proud to address the 45th Annual @March_for_Life! You are living witnesses of this year\\u2019s March for Life theme: #LoveSavesLives. https://t.co/DMST4qhDmp'\n",
      " u'\\u201cShutting down the government is a very serious thing. People die, accidents happen. I don\\u2019t know how I would vote right now on a CR, OK?\\u201d\\nSen. Dianne Feinstein (D-Calif)\\nhttps://t.co/7xP3CBnv5j'\n",
      " u'.@WhiteHouse Briefing with Director Marc Short and Director Mick Mulvaney...\\nhttps://t.co/0O0VsYXmHB'\n",
      " u'Government Funding Bill past last night in the House of Representatives. Now Democrats are needed if it is to pass in the Senate - but they want illegal immigration and weak borders. Shutdown coming? We need more Republican victories in 2018!'\n",
      " u'House of Representatives needs to pass Government Funding Bill tonight. So important for our country - our Military needs it!']\n"
     ]
    }
   ],
   "source": [
    "print tweet_text[1:8]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 104,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:57:53.982489Z",
     "start_time": "2018-01-19T01:57:53.977116Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[u'excellent preliminary meeting in oval with senschumer working on solutions for security and our great military together with senatemajldr mcconnell and speakerryan making progress four week extension would be best', u'just signed 702 bill to reauthorize foreign intelligence collection this is not the same fisa law that was so wrongly abused during the election i will always do the right thing for our country and put the safety of the american people first', u'today i was honored and proud to address the 45th annual marchforlife you are living witnesses of this years march for life theme lovesaveslives url', u'shutting down the government is a very serious thing people die accidents happen i dont know how i would vote right now on a cr ok\\nsen dianne feinstein dcalif\\nurl', u'whitehouse briefing with director marc short and director mick mulvaney\\nurl', u'government funding bill past last night in the house of representatives now democrats are needed if it is to pass in the senate but they want illegal immigration and weak borders shutdown coming we need more republican victories in 2018', u'house of representatives needs to pass government funding bill tonight so important for our country our military needs it']\n"
     ]
    }
   ],
   "source": [
    "print clean_text[1:8]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 105,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:58:42.492408Z",
     "start_time": "2018-01-19T01:58:42.483484Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.508719778042\n"
     ]
    }
   ],
   "source": [
    "#creating target\n",
    "y = tweets['handle'].map(lambda x: 1 if x == 'realDonaldTrump' else 0).values\n",
    "print max(pd.Series(y).value_counts(normalize=True))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 106,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:58:51.829129Z",
     "start_time": "2018-01-19T01:58:50.232848Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(5046, 2000)\n"
     ]
    }
   ],
   "source": [
    "from sklearn.linear_model import LogisticRegression\n",
    "from sklearn.neighbors import KNeighborsClassifier\n",
    "from sklearn.tree import DecisionTreeClassifier\n",
    "from sklearn.svm import SVC\n",
    "\n",
    "\n",
    "#Vectorizing with TF-IDF Vectorizer and creating X matrix\n",
    "tfv = TfidfVectorizer(ngram_range=(2,4), max_features=2000)\n",
    "X = tfv.fit_transform(clean_text).todense()\n",
    "print X.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 107,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Fitting 10 folds for each of 200 candidates, totalling 2000 fits\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "[Parallel(n_jobs=1)]: Done 2000 out of 2000 | elapsed:  2.2min finished\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "GridSearchCV(cv=10, error_score='raise',\n",
       "       estimator=LogisticRegression(C=1.0, class_weight=None, dual=False, fit_intercept=True,\n",
       "          intercept_scaling=1, max_iter=100, multi_class='ovr', n_jobs=1,\n",
       "          penalty='l2', random_state=None, solver='liblinear', tol=0.0001,\n",
       "          verbose=0, warm_start=False),\n",
       "       fit_params=None, iid=True, n_jobs=1,\n",
       "       param_grid={'penalty': ['l1', 'l2'], 'C': array([  1.00000e-05,   1.12332e-05, ...,   8.90215e-01,   1.00000e+00])},\n",
       "       pre_dispatch='2*n_jobs', refit=True, return_train_score='warn',\n",
       "       scoring=None, verbose=1)"
      ]
     },
     "execution_count": 107,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from sklearn.model_selection import GridSearchCV\n",
    "\n",
    "lr = LogisticRegression()\n",
    "params = {'penalty': ['l1', 'l2'], 'C':np.logspace(-5,0,100)}\n",
    "#Grid searching to find optimal parameters for Logistic Regression\n",
    "gs = GridSearchCV(lr, param_grid=params, cv=10, verbose=1)\n",
    "gs.fit(X, y)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 108,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'penalty': 'l2', 'C': 1.0}\n",
      "0.85037653587\n"
     ]
    }
   ],
   "source": [
    "print gs.best_params_\n",
    "print gs.best_score_"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## I tried Grid Searching over KNN hyperparameters but after 20 minutes it still wasn't done searching over the 120 fits I gave it. Such is life."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:58:54.965087Z",
     "start_time": "2018-01-19T01:58:54.326552Z"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.850353449006\n",
      "0.508719778042\n"
     ]
    }
   ],
   "source": [
    "from sklearn.model_selection import cross_val_score\n",
    "accuracies = cross_val_score(LogisticRegression(), X, y, cv=10)\n",
    "\n",
    "print accuracies.mean()\n",
    "print 1-y.mean()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Check the predicted probability for a random Sanders and Trump tweet\n",
    "---\n",
    "\n",
    "Below are provided a couple of tweets from both Hillary and Trump."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {
    "ExecuteTime": {
     "end_time": "2018-01-19T01:58:57.839554Z",
     "start_time": "2018-01-19T01:58:57.797480Z"
    },
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Proba_Hillary</th>\n",
       "      <th>Proba_Trump</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0.899186</td>\n",
       "      <td>0.100814</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0.313876</td>\n",
       "      <td>0.686124</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Proba_Hillary  Proba_Trump\n",
       "0       0.899186     0.100814\n",
       "1       0.313876     0.686124"
      ]
     },
     "execution_count": 45,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "estimator = LogisticRegression(penalty='l2',C=1.0)\n",
    "estimator.fit(X,y)\n",
    "\n",
    "# Prep our source as TfIdf vectors\n",
    "source_test = [\n",
    "    \"The presidency doesn’t change who you are—it reveals who you are. And we’ve seen all we need to of Donald Trump.\",\n",
    "    \"Crooked Hillary is spending tremendous amounts of Wall Street money on false ads against me. She is a very dishonest person!\"\n",
    "]\n",
    "\n",
    "###\n",
    "# NOTE:  Do not re-initialize the tfidf vectorizor or the feature space will be overwritten and\n",
    "# your transform will not match the number of features you trained your model on.\n",
    "#\n",
    "# This is why you only need to \"transform\" since you already \"fit\" previously\n",
    "#\n",
    "####\n",
    "\n",
    "Xtest = tfv.transform(source_test)\n",
    "pd.DataFrame(estimator.predict_proba(Xtest), columns=[\"Proba_Hillary\", \"Proba_Trump\"])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "So based on the model, the probablility the first tweet came from Hillary is almost 90%! The probability the second tweet came from Trump is almost 70%. So I would say the model is performing pretty well."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Now I'm going to to attempt to extract the tweets that have the highest and lowest probability of being from Trump or Hillary based on the model.\n",
    "---\n",
    "**I'm going to do this by:**\n",
    "1. Using the Predict Proba method to give me an array of the probabilites of Hillary and Trump tweets\n",
    "- Transform that array into a dataframe\n",
    "- Merge the tweets datafram and probability dataframe\n",
    "- Filter and create dataframe with only tweets of either person\n",
    "- Use a list comprehension to print out the highest and lowest probability tweets"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 0.0759295 ,  0.9240705 ],\n",
       "       [ 0.21657961,  0.78342039],\n",
       "       [ 0.39374219,  0.60625781],\n",
       "       ..., \n",
       "       [ 0.79698732,  0.20301268],\n",
       "       [ 0.58901552,  0.41098448],\n",
       "       [ 0.71431185,  0.28568815]])"
      ]
     },
     "execution_count": 46,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "estimator.predict_proba(X)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "Probas_x = pd.DataFrame(estimator.predict_proba(X), columns=[\"Proba_Hillary\", \"Proba_Donald\"])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "joined_x = pd.merge(tweets, Probas_x, left_index=True, right_index=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>created_at</th>\n",
       "      <th>handle</th>\n",
       "      <th>mined_at</th>\n",
       "      <th>retweet_count</th>\n",
       "      <th>text</th>\n",
       "      <th>tweet_id</th>\n",
       "      <th>Proba_Hillary</th>\n",
       "      <th>Proba_Donald</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Sat Jan 20 02:28:56 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818539</td>\n",
       "      <td>19358</td>\n",
       "      <td>Not looking good for our great Military or Saf...</td>\n",
       "      <td>954541219970977793</td>\n",
       "      <td>0.075930</td>\n",
       "      <td>0.924070</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Fri Jan 19 19:08:40 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078588</td>\n",
       "      <td>15886</td>\n",
       "      <td>I’m so heartened by all of you. Onward! https:...</td>\n",
       "      <td>954430425321046016</td>\n",
       "      <td>0.075930</td>\n",
       "      <td>0.924070</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Fri Jan 19 22:17:53 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818556</td>\n",
       "      <td>10458</td>\n",
       "      <td>Excellent preliminary meeting in Oval with @Se...</td>\n",
       "      <td>954478044487520257</td>\n",
       "      <td>0.216580</td>\n",
       "      <td>0.783420</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Mon Jan 15 20:48:09 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078605</td>\n",
       "      <td>23014</td>\n",
       "      <td>These words from Dr. King also come to mind to...</td>\n",
       "      <td>953005910930153472</td>\n",
       "      <td>0.216580</td>\n",
       "      <td>0.783420</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Fri Jan 19 20:53:17 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818560</td>\n",
       "      <td>21583</td>\n",
       "      <td>Just signed 702 Bill to reauthorize foreign in...</td>\n",
       "      <td>954456754137501697</td>\n",
       "      <td>0.393742</td>\n",
       "      <td>0.606258</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Mon Jan 15 17:38:41 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078610</td>\n",
       "      <td>8989</td>\n",
       "      <td>Beautifully said, @BerniceKing. An important m...</td>\n",
       "      <td>952958227825782784</td>\n",
       "      <td>0.393742</td>\n",
       "      <td>0.606258</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Fri Jan 19 18:39:50 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818565</td>\n",
       "      <td>18263</td>\n",
       "      <td>Today, I was honored and proud to address the ...</td>\n",
       "      <td>954423170299199488</td>\n",
       "      <td>0.632004</td>\n",
       "      <td>0.367996</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Fri Jan 12 19:14:45 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078614</td>\n",
       "      <td>59632</td>\n",
       "      <td>The anniversary of the devastating earthquake ...</td>\n",
       "      <td>951895239140298752</td>\n",
       "      <td>0.632004</td>\n",
       "      <td>0.367996</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Fri Jan 19 16:28:29 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818569</td>\n",
       "      <td>13044</td>\n",
       "      <td>“Shutting down the government is a very seriou...</td>\n",
       "      <td>954390114968498176</td>\n",
       "      <td>0.331828</td>\n",
       "      <td>0.668172</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Fri Jan 12 03:07:54 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078618</td>\n",
       "      <td>320</td>\n",
       "      <td>@NancyEMcFadden Nancy has a record of beating ...</td>\n",
       "      <td>951651923328987136</td>\n",
       "      <td>0.331828</td>\n",
       "      <td>0.668172</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Fri Jan 19 16:14:05 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818574</td>\n",
       "      <td>7429</td>\n",
       "      <td>.@WhiteHouse Briefing with Director Marc Short...</td>\n",
       "      <td>954386490842378241</td>\n",
       "      <td>0.540637</td>\n",
       "      <td>0.459363</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Tue Jan 02 17:27:52 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078624</td>\n",
       "      <td>8530</td>\n",
       "      <td>Families across America had to start 2018 worr...</td>\n",
       "      <td>948244463138328577</td>\n",
       "      <td>0.540637</td>\n",
       "      <td>0.459363</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Fri Jan 19 12:04:47 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818578</td>\n",
       "      <td>24130</td>\n",
       "      <td>Government Funding Bill past last night in the...</td>\n",
       "      <td>954323750949982208</td>\n",
       "      <td>0.131871</td>\n",
       "      <td>0.868129</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Tue Jan 02 17:26:39 +0000 2018</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078628</td>\n",
       "      <td>14715</td>\n",
       "      <td>Time to bring CHIP to the Senate floor as prom...</td>\n",
       "      <td>948244159986651136</td>\n",
       "      <td>0.131871</td>\n",
       "      <td>0.868129</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Thu Jan 18 23:39:53 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818582</td>\n",
       "      <td>19695</td>\n",
       "      <td>House of Representatives needs to pass Governm...</td>\n",
       "      <td>954136290768846850</td>\n",
       "      <td>0.455126</td>\n",
       "      <td>0.544874</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Sun Dec 31 03:49:33 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078632</td>\n",
       "      <td>20666</td>\n",
       "      <td>The Iranian people, especially the young, are ...</td>\n",
       "      <td>947313751992274944</td>\n",
       "      <td>0.455126</td>\n",
       "      <td>0.544874</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Thu Jan 18 21:04:36 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818586</td>\n",
       "      <td>24421</td>\n",
       "      <td>AMERICA will once again be a NATION that think...</td>\n",
       "      <td>954097213608570880</td>\n",
       "      <td>0.262080</td>\n",
       "      <td>0.737920</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Fri Dec 22 18:53:08 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078637</td>\n",
       "      <td>3153</td>\n",
       "      <td>Thank you to everyone who has donated to Onwar...</td>\n",
       "      <td>944279653883228160</td>\n",
       "      <td>0.262080</td>\n",
       "      <td>0.737920</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Thu Jan 18 20:45:33 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818590</td>\n",
       "      <td>14551</td>\n",
       "      <td>Departing Pittsburgh now, where it was my grea...</td>\n",
       "      <td>954092417250222082</td>\n",
       "      <td>0.115448</td>\n",
       "      <td>0.884552</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Fri Dec 22 18:52:12 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078641</td>\n",
       "      <td>2478</td>\n",
       "      <td>Along with @IndivisibleTeam, @ColorOfChange, @...</td>\n",
       "      <td>944279421065814016</td>\n",
       "      <td>0.115448</td>\n",
       "      <td>0.884552</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>Thu Jan 18 13:49:11 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818593</td>\n",
       "      <td>21091</td>\n",
       "      <td>A government shutdown will be devastating to o...</td>\n",
       "      <td>953987636057821184</td>\n",
       "      <td>0.044141</td>\n",
       "      <td>0.955859</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>Fri Dec 22 18:50:59 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078646</td>\n",
       "      <td>1633</td>\n",
       "      <td>And with the help of @collectivepac, 23 Africa...</td>\n",
       "      <td>944279114172850177</td>\n",
       "      <td>0.044141</td>\n",
       "      <td>0.955859</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Thu Jan 18 13:37:24 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818597</td>\n",
       "      <td>11479</td>\n",
       "      <td>CHIP should be part of a long term solution, n...</td>\n",
       "      <td>953984671674662912</td>\n",
       "      <td>0.602060</td>\n",
       "      <td>0.397940</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Fri Dec 22 18:50:12 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078650</td>\n",
       "      <td>1260</td>\n",
       "      <td>More than 400 students and leaders met last mo...</td>\n",
       "      <td>944278916621066240</td>\n",
       "      <td>0.602060</td>\n",
       "      <td>0.397940</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Thu Jan 18 13:16:26 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818601</td>\n",
       "      <td>27284</td>\n",
       "      <td>We need the Wall for the safety and security o...</td>\n",
       "      <td>953979393180950528</td>\n",
       "      <td>0.135037</td>\n",
       "      <td>0.864963</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Fri Dec 22 18:49:41 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078655</td>\n",
       "      <td>1426</td>\n",
       "      <td>The team at @latinovictoryus is working to ele...</td>\n",
       "      <td>944278786874527744</td>\n",
       "      <td>0.135037</td>\n",
       "      <td>0.864963</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Thu Jan 18 12:53:17 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818605</td>\n",
       "      <td>16668</td>\n",
       "      <td>Will be going to Pennsylvania today in order t...</td>\n",
       "      <td>953973568035086336</td>\n",
       "      <td>0.111002</td>\n",
       "      <td>0.888998</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Fri Dec 22 18:47:02 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078658</td>\n",
       "      <td>1355</td>\n",
       "      <td>At @alliance4youth, young people are using loc...</td>\n",
       "      <td>944278119237681152</td>\n",
       "      <td>0.111002</td>\n",
       "      <td>0.888998</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Thu Jan 18 11:25:03 +0000 2018</td>\n",
       "      <td>realDonaldTrump</td>\n",
       "      <td>2018-01-20 01:29:58.818609</td>\n",
       "      <td>27223</td>\n",
       "      <td>....The Wall will be paid for, directly or ind...</td>\n",
       "      <td>953951365532876800</td>\n",
       "      <td>0.032925</td>\n",
       "      <td>0.967075</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Fri Dec 22 18:46:05 +0000 2017</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:17.078663</td>\n",
       "      <td>1516</td>\n",
       "      <td>450 brand-new civic leaders and activists atte...</td>\n",
       "      <td>944277880028237826</td>\n",
       "      <td>0.032925</td>\n",
       "      <td>0.967075</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2537</th>\n",
       "      <td>Tue Jul 26 03:22:21 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829647</td>\n",
       "      <td>2342</td>\n",
       "      <td>\"I served with her in the United States Senate...</td>\n",
       "      <td>757778054815047680</td>\n",
       "      <td>0.551781</td>\n",
       "      <td>0.448219</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2538</th>\n",
       "      <td>Tue Jul 26 03:18:21 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829651</td>\n",
       "      <td>4968</td>\n",
       "      <td>\"While...Trump is busy insulting one group aft...</td>\n",
       "      <td>757777047523557376</td>\n",
       "      <td>0.429951</td>\n",
       "      <td>0.570049</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2539</th>\n",
       "      <td>Tue Jul 26 03:17:02 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829654</td>\n",
       "      <td>2587</td>\n",
       "      <td>\"Donald Trump? Well, like most Republicans, he...</td>\n",
       "      <td>757776714273546241</td>\n",
       "      <td>0.483098</td>\n",
       "      <td>0.516902</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2540</th>\n",
       "      <td>Tue Jul 26 03:10:01 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829658</td>\n",
       "      <td>2667</td>\n",
       "      <td>“Hillary Clinton will nominate justices to the...</td>\n",
       "      <td>757774948928720896</td>\n",
       "      <td>0.828362</td>\n",
       "      <td>0.171638</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2541</th>\n",
       "      <td>Tue Jul 26 03:07:41 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829662</td>\n",
       "      <td>2711</td>\n",
       "      <td>\"Hillary...understands that if someone in this...</td>\n",
       "      <td>757774363458433024</td>\n",
       "      <td>0.521009</td>\n",
       "      <td>0.478991</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2542</th>\n",
       "      <td>Tue Jul 26 03:06:12 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829666</td>\n",
       "      <td>4911</td>\n",
       "      <td>\"Hillary Clinton must become the next presiden...</td>\n",
       "      <td>757773990173806592</td>\n",
       "      <td>0.586321</td>\n",
       "      <td>0.413679</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2543</th>\n",
       "      <td>Tue Jul 26 03:04:28 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829669</td>\n",
       "      <td>2031</td>\n",
       "      <td>\"We have come a long way in the last 7 1/2 yea...</td>\n",
       "      <td>757773551751598080</td>\n",
       "      <td>0.744015</td>\n",
       "      <td>0.255985</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2544</th>\n",
       "      <td>Tue Jul 26 02:55:53 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829673</td>\n",
       "      <td>723</td>\n",
       "      <td>Happening now: Watch @BernieSanders address th...</td>\n",
       "      <td>757771391093600256</td>\n",
       "      <td>0.540637</td>\n",
       "      <td>0.459363</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2545</th>\n",
       "      <td>Tue Jul 26 02:49:57 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829676</td>\n",
       "      <td>2171</td>\n",
       "      <td>\"Trump’s entire campaign is just one more, lat...</td>\n",
       "      <td>757769901402681344</td>\n",
       "      <td>0.178168</td>\n",
       "      <td>0.821832</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2546</th>\n",
       "      <td>Tue Jul 26 02:46:55 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829680</td>\n",
       "      <td>3417</td>\n",
       "      <td>Couldn’t agree more, @POTUS. https://t.co/hvsf...</td>\n",
       "      <td>757769136269320193</td>\n",
       "      <td>0.734086</td>\n",
       "      <td>0.265914</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2547</th>\n",
       "      <td>Tue Jul 26 02:45:12 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829683</td>\n",
       "      <td>1638</td>\n",
       "      <td>“If you believe we are stronger together, then...</td>\n",
       "      <td>757768703521988610</td>\n",
       "      <td>0.540637</td>\n",
       "      <td>0.459363</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2548</th>\n",
       "      <td>Tue Jul 26 02:42:12 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829687</td>\n",
       "      <td>2390</td>\n",
       "      <td>“We’re not going to be Donald Trump’s hate-fil...</td>\n",
       "      <td>757767949327400964</td>\n",
       "      <td>0.865495</td>\n",
       "      <td>0.134505</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2549</th>\n",
       "      <td>Tue Jul 26 02:41:43 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829691</td>\n",
       "      <td>1878</td>\n",
       "      <td>\"When we turn on each other, we can’t unite to...</td>\n",
       "      <td>757767826648231936</td>\n",
       "      <td>0.829229</td>\n",
       "      <td>0.170771</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2550</th>\n",
       "      <td>Tue Jul 26 02:39:51 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829695</td>\n",
       "      <td>1499</td>\n",
       "      <td>“That’s Donald Trump’s America—an America of f...</td>\n",
       "      <td>757767359843147776</td>\n",
       "      <td>0.738669</td>\n",
       "      <td>0.261331</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2551</th>\n",
       "      <td>Tue Jul 26 02:39:19 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829698</td>\n",
       "      <td>2381</td>\n",
       "      <td>\"He even picked a vice president famous for tr...</td>\n",
       "      <td>757767223134093316</td>\n",
       "      <td>0.860482</td>\n",
       "      <td>0.139518</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2552</th>\n",
       "      <td>Tue Jul 26 02:37:02 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829702</td>\n",
       "      <td>3570</td>\n",
       "      <td>\"Last week...Trump spoke for more than an hour...</td>\n",
       "      <td>757766649474912257</td>\n",
       "      <td>0.623102</td>\n",
       "      <td>0.376898</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2553</th>\n",
       "      <td>Tue Jul 26 02:36:29 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829705</td>\n",
       "      <td>2691</td>\n",
       "      <td>\"What kind of a man cheats students, cheats in...</td>\n",
       "      <td>757766513013194752</td>\n",
       "      <td>0.540637</td>\n",
       "      <td>0.459363</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2554</th>\n",
       "      <td>Tue Jul 26 02:34:40 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829709</td>\n",
       "      <td>2648</td>\n",
       "      <td>\"What kind of a man roots for an economic cras...</td>\n",
       "      <td>757766052428312576</td>\n",
       "      <td>0.706601</td>\n",
       "      <td>0.293399</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2555</th>\n",
       "      <td>Tue Jul 26 02:34:01 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829712</td>\n",
       "      <td>1600</td>\n",
       "      <td>\"He preyed on...people who had fallen on hard ...</td>\n",
       "      <td>757765891908132864</td>\n",
       "      <td>0.677088</td>\n",
       "      <td>0.322912</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2556</th>\n",
       "      <td>Tue Jul 26 02:27:48 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829716</td>\n",
       "      <td>454</td>\n",
       "      <td>Watch @ElizabethForMA live at the #DemConventi...</td>\n",
       "      <td>757764326128283648</td>\n",
       "      <td>0.797530</td>\n",
       "      <td>0.202470</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2557</th>\n",
       "      <td>Tue Jul 26 02:26:28 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829720</td>\n",
       "      <td>3971</td>\n",
       "      <td>\"Hillary Clinton has never quit on anything in...</td>\n",
       "      <td>757763989359173632</td>\n",
       "      <td>0.614771</td>\n",
       "      <td>0.385229</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2558</th>\n",
       "      <td>Tue Jul 26 02:21:30 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829723</td>\n",
       "      <td>2597</td>\n",
       "      <td>\"We need to pour every last ounce of our passi...</td>\n",
       "      <td>757762738433191936</td>\n",
       "      <td>0.762007</td>\n",
       "      <td>0.237993</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2559</th>\n",
       "      <td>Tue Jul 26 02:20:08 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829727</td>\n",
       "      <td>5081</td>\n",
       "      <td>\"Don’t let anyone ever tell you that this coun...</td>\n",
       "      <td>757762395787911168</td>\n",
       "      <td>0.695428</td>\n",
       "      <td>0.304572</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2560</th>\n",
       "      <td>Tue Jul 26 02:19:26 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829730</td>\n",
       "      <td>4801</td>\n",
       "      <td>“Because of Hillary Clinton, my daughters…now ...</td>\n",
       "      <td>757762219300052992</td>\n",
       "      <td>0.776927</td>\n",
       "      <td>0.223073</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2561</th>\n",
       "      <td>Tue Jul 26 02:16:18 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829734</td>\n",
       "      <td>2552</td>\n",
       "      <td>\"Hillary understands that the presidency is ab...</td>\n",
       "      <td>757761430477279232</td>\n",
       "      <td>0.547562</td>\n",
       "      <td>0.452438</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2562</th>\n",
       "      <td>Tue Jul 26 02:16:01 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829737</td>\n",
       "      <td>1893</td>\n",
       "      <td>\"In this election, I’m with her!\" —@FLOTUS on ...</td>\n",
       "      <td>757761359035699200</td>\n",
       "      <td>0.507462</td>\n",
       "      <td>0.492538</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2563</th>\n",
       "      <td>Tue Jul 26 02:15:11 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829741</td>\n",
       "      <td>2219</td>\n",
       "      <td>\"We don’t turn against each other—no, we liste...</td>\n",
       "      <td>757761152231346176</td>\n",
       "      <td>0.786145</td>\n",
       "      <td>0.213855</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2564</th>\n",
       "      <td>Tue Jul 26 02:14:14 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829745</td>\n",
       "      <td>1496</td>\n",
       "      <td>\"Hillary Clinton has never quit on anything in...</td>\n",
       "      <td>757760912581419008</td>\n",
       "      <td>0.485150</td>\n",
       "      <td>0.514850</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2565</th>\n",
       "      <td>Tue Jul 26 02:12:21 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829748</td>\n",
       "      <td>3985</td>\n",
       "      <td>\"When she didn’t win the nomination 8 years ag...</td>\n",
       "      <td>757760436842459137</td>\n",
       "      <td>0.671538</td>\n",
       "      <td>0.328462</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2566</th>\n",
       "      <td>Tue Jul 26 02:10:21 +0000 2016</td>\n",
       "      <td>HillaryClinton</td>\n",
       "      <td>2018-01-20 01:32:23.829752</td>\n",
       "      <td>2453</td>\n",
       "      <td>\"There is only one person...truly qualified to...</td>\n",
       "      <td>757759935136600064</td>\n",
       "      <td>0.619879</td>\n",
       "      <td>0.380121</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5046 rows × 8 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                          created_at           handle  \\\n",
       "0     Sat Jan 20 02:28:56 +0000 2018  realDonaldTrump   \n",
       "0     Fri Jan 19 19:08:40 +0000 2018   HillaryClinton   \n",
       "1     Fri Jan 19 22:17:53 +0000 2018  realDonaldTrump   \n",
       "1     Mon Jan 15 20:48:09 +0000 2018   HillaryClinton   \n",
       "2     Fri Jan 19 20:53:17 +0000 2018  realDonaldTrump   \n",
       "2     Mon Jan 15 17:38:41 +0000 2018   HillaryClinton   \n",
       "3     Fri Jan 19 18:39:50 +0000 2018  realDonaldTrump   \n",
       "3     Fri Jan 12 19:14:45 +0000 2018   HillaryClinton   \n",
       "4     Fri Jan 19 16:28:29 +0000 2018  realDonaldTrump   \n",
       "4     Fri Jan 12 03:07:54 +0000 2018   HillaryClinton   \n",
       "5     Fri Jan 19 16:14:05 +0000 2018  realDonaldTrump   \n",
       "5     Tue Jan 02 17:27:52 +0000 2018   HillaryClinton   \n",
       "6     Fri Jan 19 12:04:47 +0000 2018  realDonaldTrump   \n",
       "6     Tue Jan 02 17:26:39 +0000 2018   HillaryClinton   \n",
       "7     Thu Jan 18 23:39:53 +0000 2018  realDonaldTrump   \n",
       "7     Sun Dec 31 03:49:33 +0000 2017   HillaryClinton   \n",
       "8     Thu Jan 18 21:04:36 +0000 2018  realDonaldTrump   \n",
       "8     Fri Dec 22 18:53:08 +0000 2017   HillaryClinton   \n",
       "9     Thu Jan 18 20:45:33 +0000 2018  realDonaldTrump   \n",
       "9     Fri Dec 22 18:52:12 +0000 2017   HillaryClinton   \n",
       "10    Thu Jan 18 13:49:11 +0000 2018  realDonaldTrump   \n",
       "10    Fri Dec 22 18:50:59 +0000 2017   HillaryClinton   \n",
       "11    Thu Jan 18 13:37:24 +0000 2018  realDonaldTrump   \n",
       "11    Fri Dec 22 18:50:12 +0000 2017   HillaryClinton   \n",
       "12    Thu Jan 18 13:16:26 +0000 2018  realDonaldTrump   \n",
       "12    Fri Dec 22 18:49:41 +0000 2017   HillaryClinton   \n",
       "13    Thu Jan 18 12:53:17 +0000 2018  realDonaldTrump   \n",
       "13    Fri Dec 22 18:47:02 +0000 2017   HillaryClinton   \n",
       "14    Thu Jan 18 11:25:03 +0000 2018  realDonaldTrump   \n",
       "14    Fri Dec 22 18:46:05 +0000 2017   HillaryClinton   \n",
       "...                              ...              ...   \n",
       "2537  Tue Jul 26 03:22:21 +0000 2016   HillaryClinton   \n",
       "2538  Tue Jul 26 03:18:21 +0000 2016   HillaryClinton   \n",
       "2539  Tue Jul 26 03:17:02 +0000 2016   HillaryClinton   \n",
       "2540  Tue Jul 26 03:10:01 +0000 2016   HillaryClinton   \n",
       "2541  Tue Jul 26 03:07:41 +0000 2016   HillaryClinton   \n",
       "2542  Tue Jul 26 03:06:12 +0000 2016   HillaryClinton   \n",
       "2543  Tue Jul 26 03:04:28 +0000 2016   HillaryClinton   \n",
       "2544  Tue Jul 26 02:55:53 +0000 2016   HillaryClinton   \n",
       "2545  Tue Jul 26 02:49:57 +0000 2016   HillaryClinton   \n",
       "2546  Tue Jul 26 02:46:55 +0000 2016   HillaryClinton   \n",
       "2547  Tue Jul 26 02:45:12 +0000 2016   HillaryClinton   \n",
       "2548  Tue Jul 26 02:42:12 +0000 2016   HillaryClinton   \n",
       "2549  Tue Jul 26 02:41:43 +0000 2016   HillaryClinton   \n",
       "2550  Tue Jul 26 02:39:51 +0000 2016   HillaryClinton   \n",
       "2551  Tue Jul 26 02:39:19 +0000 2016   HillaryClinton   \n",
       "2552  Tue Jul 26 02:37:02 +0000 2016   HillaryClinton   \n",
       "2553  Tue Jul 26 02:36:29 +0000 2016   HillaryClinton   \n",
       "2554  Tue Jul 26 02:34:40 +0000 2016   HillaryClinton   \n",
       "2555  Tue Jul 26 02:34:01 +0000 2016   HillaryClinton   \n",
       "2556  Tue Jul 26 02:27:48 +0000 2016   HillaryClinton   \n",
       "2557  Tue Jul 26 02:26:28 +0000 2016   HillaryClinton   \n",
       "2558  Tue Jul 26 02:21:30 +0000 2016   HillaryClinton   \n",
       "2559  Tue Jul 26 02:20:08 +0000 2016   HillaryClinton   \n",
       "2560  Tue Jul 26 02:19:26 +0000 2016   HillaryClinton   \n",
       "2561  Tue Jul 26 02:16:18 +0000 2016   HillaryClinton   \n",
       "2562  Tue Jul 26 02:16:01 +0000 2016   HillaryClinton   \n",
       "2563  Tue Jul 26 02:15:11 +0000 2016   HillaryClinton   \n",
       "2564  Tue Jul 26 02:14:14 +0000 2016   HillaryClinton   \n",
       "2565  Tue Jul 26 02:12:21 +0000 2016   HillaryClinton   \n",
       "2566  Tue Jul 26 02:10:21 +0000 2016   HillaryClinton   \n",
       "\n",
       "                       mined_at  retweet_count  \\\n",
       "0    2018-01-20 01:29:58.818539          19358   \n",
       "0    2018-01-20 01:32:17.078588          15886   \n",
       "1    2018-01-20 01:29:58.818556          10458   \n",
       "1    2018-01-20 01:32:17.078605          23014   \n",
       "2    2018-01-20 01:29:58.818560          21583   \n",
       "2    2018-01-20 01:32:17.078610           8989   \n",
       "3    2018-01-20 01:29:58.818565          18263   \n",
       "3    2018-01-20 01:32:17.078614          59632   \n",
       "4    2018-01-20 01:29:58.818569          13044   \n",
       "4    2018-01-20 01:32:17.078618            320   \n",
       "5    2018-01-20 01:29:58.818574           7429   \n",
       "5    2018-01-20 01:32:17.078624           8530   \n",
       "6    2018-01-20 01:29:58.818578          24130   \n",
       "6    2018-01-20 01:32:17.078628          14715   \n",
       "7    2018-01-20 01:29:58.818582          19695   \n",
       "7    2018-01-20 01:32:17.078632          20666   \n",
       "8    2018-01-20 01:29:58.818586          24421   \n",
       "8    2018-01-20 01:32:17.078637           3153   \n",
       "9    2018-01-20 01:29:58.818590          14551   \n",
       "9    2018-01-20 01:32:17.078641           2478   \n",
       "10   2018-01-20 01:29:58.818593          21091   \n",
       "10   2018-01-20 01:32:17.078646           1633   \n",
       "11   2018-01-20 01:29:58.818597          11479   \n",
       "11   2018-01-20 01:32:17.078650           1260   \n",
       "12   2018-01-20 01:29:58.818601          27284   \n",
       "12   2018-01-20 01:32:17.078655           1426   \n",
       "13   2018-01-20 01:29:58.818605          16668   \n",
       "13   2018-01-20 01:32:17.078658           1355   \n",
       "14   2018-01-20 01:29:58.818609          27223   \n",
       "14   2018-01-20 01:32:17.078663           1516   \n",
       "...                         ...            ...   \n",
       "2537 2018-01-20 01:32:23.829647           2342   \n",
       "2538 2018-01-20 01:32:23.829651           4968   \n",
       "2539 2018-01-20 01:32:23.829654           2587   \n",
       "2540 2018-01-20 01:32:23.829658           2667   \n",
       "2541 2018-01-20 01:32:23.829662           2711   \n",
       "2542 2018-01-20 01:32:23.829666           4911   \n",
       "2543 2018-01-20 01:32:23.829669           2031   \n",
       "2544 2018-01-20 01:32:23.829673            723   \n",
       "2545 2018-01-20 01:32:23.829676           2171   \n",
       "2546 2018-01-20 01:32:23.829680           3417   \n",
       "2547 2018-01-20 01:32:23.829683           1638   \n",
       "2548 2018-01-20 01:32:23.829687           2390   \n",
       "2549 2018-01-20 01:32:23.829691           1878   \n",
       "2550 2018-01-20 01:32:23.829695           1499   \n",
       "2551 2018-01-20 01:32:23.829698           2381   \n",
       "2552 2018-01-20 01:32:23.829702           3570   \n",
       "2553 2018-01-20 01:32:23.829705           2691   \n",
       "2554 2018-01-20 01:32:23.829709           2648   \n",
       "2555 2018-01-20 01:32:23.829712           1600   \n",
       "2556 2018-01-20 01:32:23.829716            454   \n",
       "2557 2018-01-20 01:32:23.829720           3971   \n",
       "2558 2018-01-20 01:32:23.829723           2597   \n",
       "2559 2018-01-20 01:32:23.829727           5081   \n",
       "2560 2018-01-20 01:32:23.829730           4801   \n",
       "2561 2018-01-20 01:32:23.829734           2552   \n",
       "2562 2018-01-20 01:32:23.829737           1893   \n",
       "2563 2018-01-20 01:32:23.829741           2219   \n",
       "2564 2018-01-20 01:32:23.829745           1496   \n",
       "2565 2018-01-20 01:32:23.829748           3985   \n",
       "2566 2018-01-20 01:32:23.829752           2453   \n",
       "\n",
       "                                                   text            tweet_id  \\\n",
       "0     Not looking good for our great Military or Saf...  954541219970977793   \n",
       "0     I’m so heartened by all of you. Onward! https:...  954430425321046016   \n",
       "1     Excellent preliminary meeting in Oval with @Se...  954478044487520257   \n",
       "1     These words from Dr. King also come to mind to...  953005910930153472   \n",
       "2     Just signed 702 Bill to reauthorize foreign in...  954456754137501697   \n",
       "2     Beautifully said, @BerniceKing. An important m...  952958227825782784   \n",
       "3     Today, I was honored and proud to address the ...  954423170299199488   \n",
       "3     The anniversary of the devastating earthquake ...  951895239140298752   \n",
       "4     “Shutting down the government is a very seriou...  954390114968498176   \n",
       "4     @NancyEMcFadden Nancy has a record of beating ...  951651923328987136   \n",
       "5     .@WhiteHouse Briefing with Director Marc Short...  954386490842378241   \n",
       "5     Families across America had to start 2018 worr...  948244463138328577   \n",
       "6     Government Funding Bill past last night in the...  954323750949982208   \n",
       "6     Time to bring CHIP to the Senate floor as prom...  948244159986651136   \n",
       "7     House of Representatives needs to pass Governm...  954136290768846850   \n",
       "7     The Iranian people, especially the young, are ...  947313751992274944   \n",
       "8     AMERICA will once again be a NATION that think...  954097213608570880   \n",
       "8     Thank you to everyone who has donated to Onwar...  944279653883228160   \n",
       "9     Departing Pittsburgh now, where it was my grea...  954092417250222082   \n",
       "9     Along with @IndivisibleTeam, @ColorOfChange, @...  944279421065814016   \n",
       "10    A government shutdown will be devastating to o...  953987636057821184   \n",
       "10    And with the help of @collectivepac, 23 Africa...  944279114172850177   \n",
       "11    CHIP should be part of a long term solution, n...  953984671674662912   \n",
       "11    More than 400 students and leaders met last mo...  944278916621066240   \n",
       "12    We need the Wall for the safety and security o...  953979393180950528   \n",
       "12    The team at @latinovictoryus is working to ele...  944278786874527744   \n",
       "13    Will be going to Pennsylvania today in order t...  953973568035086336   \n",
       "13    At @alliance4youth, young people are using loc...  944278119237681152   \n",
       "14    ....The Wall will be paid for, directly or ind...  953951365532876800   \n",
       "14    450 brand-new civic leaders and activists atte...  944277880028237826   \n",
       "...                                                 ...                 ...   \n",
       "2537  \"I served with her in the United States Senate...  757778054815047680   \n",
       "2538  \"While...Trump is busy insulting one group aft...  757777047523557376   \n",
       "2539  \"Donald Trump? Well, like most Republicans, he...  757776714273546241   \n",
       "2540  “Hillary Clinton will nominate justices to the...  757774948928720896   \n",
       "2541  \"Hillary...understands that if someone in this...  757774363458433024   \n",
       "2542  \"Hillary Clinton must become the next presiden...  757773990173806592   \n",
       "2543  \"We have come a long way in the last 7 1/2 yea...  757773551751598080   \n",
       "2544  Happening now: Watch @BernieSanders address th...  757771391093600256   \n",
       "2545  \"Trump’s entire campaign is just one more, lat...  757769901402681344   \n",
       "2546  Couldn’t agree more, @POTUS. https://t.co/hvsf...  757769136269320193   \n",
       "2547  “If you believe we are stronger together, then...  757768703521988610   \n",
       "2548  “We’re not going to be Donald Trump’s hate-fil...  757767949327400964   \n",
       "2549  \"When we turn on each other, we can’t unite to...  757767826648231936   \n",
       "2550  “That’s Donald Trump’s America—an America of f...  757767359843147776   \n",
       "2551  \"He even picked a vice president famous for tr...  757767223134093316   \n",
       "2552  \"Last week...Trump spoke for more than an hour...  757766649474912257   \n",
       "2553  \"What kind of a man cheats students, cheats in...  757766513013194752   \n",
       "2554  \"What kind of a man roots for an economic cras...  757766052428312576   \n",
       "2555  \"He preyed on...people who had fallen on hard ...  757765891908132864   \n",
       "2556  Watch @ElizabethForMA live at the #DemConventi...  757764326128283648   \n",
       "2557  \"Hillary Clinton has never quit on anything in...  757763989359173632   \n",
       "2558  \"We need to pour every last ounce of our passi...  757762738433191936   \n",
       "2559  \"Don’t let anyone ever tell you that this coun...  757762395787911168   \n",
       "2560  “Because of Hillary Clinton, my daughters…now ...  757762219300052992   \n",
       "2561  \"Hillary understands that the presidency is ab...  757761430477279232   \n",
       "2562  \"In this election, I’m with her!\" —@FLOTUS on ...  757761359035699200   \n",
       "2563  \"We don’t turn against each other—no, we liste...  757761152231346176   \n",
       "2564  \"Hillary Clinton has never quit on anything in...  757760912581419008   \n",
       "2565  \"When she didn’t win the nomination 8 years ag...  757760436842459137   \n",
       "2566  \"There is only one person...truly qualified to...  757759935136600064   \n",
       "\n",
       "      Proba_Hillary  Proba_Donald  \n",
       "0          0.075930      0.924070  \n",
       "0          0.075930      0.924070  \n",
       "1          0.216580      0.783420  \n",
       "1          0.216580      0.783420  \n",
       "2          0.393742      0.606258  \n",
       "2          0.393742      0.606258  \n",
       "3          0.632004      0.367996  \n",
       "3          0.632004      0.367996  \n",
       "4          0.331828      0.668172  \n",
       "4          0.331828      0.668172  \n",
       "5          0.540637      0.459363  \n",
       "5          0.540637      0.459363  \n",
       "6          0.131871      0.868129  \n",
       "6          0.131871      0.868129  \n",
       "7          0.455126      0.544874  \n",
       "7          0.455126      0.544874  \n",
       "8          0.262080      0.737920  \n",
       "8          0.262080      0.737920  \n",
       "9          0.115448      0.884552  \n",
       "9          0.115448      0.884552  \n",
       "10         0.044141      0.955859  \n",
       "10         0.044141      0.955859  \n",
       "11         0.602060      0.397940  \n",
       "11         0.602060      0.397940  \n",
       "12         0.135037      0.864963  \n",
       "12         0.135037      0.864963  \n",
       "13         0.111002      0.888998  \n",
       "13         0.111002      0.888998  \n",
       "14         0.032925      0.967075  \n",
       "14         0.032925      0.967075  \n",
       "...             ...           ...  \n",
       "2537       0.551781      0.448219  \n",
       "2538       0.429951      0.570049  \n",
       "2539       0.483098      0.516902  \n",
       "2540       0.828362      0.171638  \n",
       "2541       0.521009      0.478991  \n",
       "2542       0.586321      0.413679  \n",
       "2543       0.744015      0.255985  \n",
       "2544       0.540637      0.459363  \n",
       "2545       0.178168      0.821832  \n",
       "2546       0.734086      0.265914  \n",
       "2547       0.540637      0.459363  \n",
       "2548       0.865495      0.134505  \n",
       "2549       0.829229      0.170771  \n",
       "2550       0.738669      0.261331  \n",
       "2551       0.860482      0.139518  \n",
       "2552       0.623102      0.376898  \n",
       "2553       0.540637      0.459363  \n",
       "2554       0.706601      0.293399  \n",
       "2555       0.677088      0.322912  \n",
       "2556       0.797530      0.202470  \n",
       "2557       0.614771      0.385229  \n",
       "2558       0.762007      0.237993  \n",
       "2559       0.695428      0.304572  \n",
       "2560       0.776927      0.223073  \n",
       "2561       0.547562      0.452438  \n",
       "2562       0.507462      0.492538  \n",
       "2563       0.786145      0.213855  \n",
       "2564       0.485150      0.514850  \n",
       "2565       0.671538      0.328462  \n",
       "2566       0.619879      0.380121  \n",
       "\n",
       "[5046 rows x 8 columns]"
      ]
     },
     "execution_count": 49,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "joined_x"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\"She is the best qualified person for this moment in history.\" —@BillClinton on Hillary\n",
      "https://t.co/WkYfkT9MqX\n"
     ]
    }
   ],
   "source": [
    "joined_hillary = joined_x[joined_x['handle']==\"HillaryClinton\"]\n",
    "for el in joined_hillary[joined_hillary['Proba_Hillary']==max(joined_hillary['Proba_Hillary'])]['text']:\n",
    "    print el"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 51,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "In just 3 days, we have the chance to make history:\n",
      "\n",
      "Join Hillary live in Florida as she gets out the vote: https://t.co/oa4NZ1hEHU\n"
     ]
    }
   ],
   "source": [
    "for el in joined_hillary[joined_hillary['Proba_Hillary']==min(joined_hillary['Proba_Hillary'])]['text']:\n",
    "    print el"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "ObamaCare premiums are going up, up, up, just as I have been predicting for two years. ObamaCare is OWNED by the Democrats, and it is a disaster. But do not worry. Even though the Dems want to Obstruct, we will Repeal &amp; Replace right after Tax Cuts!\n"
     ]
    }
   ],
   "source": [
    "joined_donald = joined_x[joined_x['handle']==\"realDonaldTrump\"]\n",
    "for el in joined_donald[joined_donald['Proba_Donald']==max(joined_donald['Proba_Donald'])]['text']:\n",
    "    print el"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 53,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Heed the advice of @FLGovScott!\n",
      "\n",
      "\"If you're in an evacuation zone, you need to get to a shelter...there's not many hours left.\" Gov. Scott https://t.co/92W8ViNMUK\n"
     ]
    }
   ],
   "source": [
    "for el in joined_donald[joined_donald['Proba_Donald']==min(joined_donald['Proba_Donald'])]['text']:\n",
    "    print el"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Pull tweets for some new users.\n",
    "\n",
    "Now that we've seen that the model works pretty well with the Trump and Hillary tweets, I'm going to pull some of the tweets of my former collegues at The Tab Media Inc. Namely Amanda Ross, Una Dabiero, Josh Kaplan, and Matt McDonald. I'm going to compare their tweets just like I did Trump and Hillary."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## First, it's Amanda and Una's turn. I'm repeatin the same process I used for Trump and Hillary."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "x = api.GetUserTimeline(screen_name=\"una_dab\", count=20, include_rts=False)\n",
    "x = [_.AsDict() for _ in x]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{u'created_at': u'Sat Jan 20 02:17:07 +0000 2018',\n",
       " u'favorite_count': 1,\n",
       " u'full_text': u'Also him: \\u201cI like \\u2018Motorsport\\u2019\\u201d',\n",
       " u'hashtags': [],\n",
       " u'id': 954538246897389568,\n",
       " u'id_str': u'954538246897389568',\n",
       " u'in_reply_to_screen_name': u'una_dab',\n",
       " u'in_reply_to_status_id': 954538036657868800,\n",
       " u'in_reply_to_user_id': 958603717,\n",
       " u'lang': u'en',\n",
       " u'source': u'<a href=\"http://twitter.com/download/iphone\" rel=\"nofollow\">Twitter for iPhone</a>',\n",
       " u'urls': [],\n",
       " u'user': {u'created_at': u'Mon Nov 19 21:26:15 +0000 2012',\n",
       "  u'description': u'just a paranoid virgo \\u264d\\ufe0f \\u2022 i write for @babedotnet \\u2022',\n",
       "  u'favourites_count': 5607,\n",
       "  u'followers_count': 368,\n",
       "  u'following': True,\n",
       "  u'friends_count': 397,\n",
       "  u'id': 958603717,\n",
       "  u'lang': u'en',\n",
       "  u'listed_count': 1,\n",
       "  u'name': u'Una Dabiero',\n",
       "  u'profile_background_color': u'000000',\n",
       "  u'profile_background_image_url': u'http://abs.twimg.com/images/themes/theme1/bg.png',\n",
       "  u'profile_banner_url': u'https://pbs.twimg.com/profile_banners/958603717/1489491657',\n",
       "  u'profile_image_url': u'http://pbs.twimg.com/profile_images/950767690301497347/vpQIURZ6_normal.jpg',\n",
       "  u'profile_link_color': u'F5ABB5',\n",
       "  u'profile_sidebar_fill_color': u'000000',\n",
       "  u'profile_text_color': u'000000',\n",
       "  u'screen_name': u'una_dab',\n",
       "  u'statuses_count': 4514},\n",
       " u'user_mentions': []}"
      ]
     },
     "execution_count": 55,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "x[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "954538246897389568\n",
      "Also him: “I like ‘Motorsport’”\n",
      "--\n",
      "954538036657868800\n",
      "today my dad told me he “likes that guy Gucci Mane” so I’m gonna go kill myself\n",
      "--\n",
      "954389341220102145\n",
      "how?!??? why??!?? https://t.co/mPnxfsfZjH\n",
      "--\n",
      "954105154340622337\n",
      "trendy!!!!!! https://t.co/xDq403aujt\n",
      "--\n",
      "953706030256533504\n",
      "-@realJoeCalder\n",
      "--\n",
      "953705538407337985\n",
      "Seen in a Bushwick bookstore: https://t.co/2zCcpaa5md\n",
      "--\n",
      "953606233868722176\n",
      "Facebook reminds me everyday to never feel THAT good about myself https://t.co/sw8m3re0nK\n",
      "--\n",
      "953338055192207360\n",
      "NEW content FUN times WOw https://t.co/hwMcE5ZTCy\n",
      "--\n",
      "952970600435331072\n",
      "TW/CW: victim-blaming\n",
      "This is why we need a cultural change, now. https://t.co/lFRr2ZJpEI\n",
      "--\n",
      "952953619502059520\n",
      "Just a normal day at https://t.co/1o7dzK5Llp!! https://t.co/6LAbIJcGBF\n",
      "--\n",
      "952937480768118785\n",
      "@thecolorhannah Hey Hannah, I'm a writer at @babedotnet. I read your #MeToo story and would really appreciate talking about your experience - its hauntingly relatable and so important. dm me!\n",
      "--\n"
     ]
    }
   ],
   "source": [
    "for element in x:\n",
    "    print element['id']\n",
    "    print(element['full_text'])\n",
    "    print('--')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 57,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "y = api.GetUserTimeline(screen_name=\"itsamandaross\", count=20, max_id=935706980643147777, include_rts=False)\n",
    "y = [_.AsDict() for _ in y]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 58,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "935675057816383489\n",
      "Give me this level of confidence and entitlement pls lmaooo https://t.co/uOFdBFqEGh\n",
      "--\n",
      "935524157411995648\n",
      "current mood: third-class passenger trapped in the hull of the titanic as it sank https://t.co/9uIZh5ITFB\n",
      "--\n",
      "935521727869804545\n",
      "another year gone by https://t.co/D5vW4Mpuw4\n",
      "--\n",
      "935504294702473218\n",
      "Whomst snitched https://t.co/GNOaN2zalD\n",
      "--\n",
      "935313039275982848\n",
      "Just listened to Ashlee Simpson’s Pieces of Me and now I’m sad and hope I die in my sleep https://t.co/hx1C2vpXjY\n",
      "--\n",
      "934969391481020416\n",
      "What did this little bitch just call me https://t.co/AmoEwmU7X0\n",
      "--\n",
      "934958900822016001\n",
      "Well he looks dead https://t.co/fMpd24F1PU\n",
      "--\n",
      "934908130659569665\n",
      "@DixPeyton Just give in\n",
      "--\n",
      "934886215073128448\n",
      "If anyone is playing Pocket Camp, PLEASE ADD ME I NEED TO GIVE KUDOS!!!!! https://t.co/8idiyCqK85\n",
      "--\n",
      "934817432312729601\n",
      "The crackheads in Brooklyn are more powerful than the ones in my neighborhood\n",
      "--\n",
      "934648855806775298\n",
      "@mattjpfmcdonald @ABC Ok so you can do this but you can’t text me back\n",
      "--\n",
      "934601048039272449\n",
      "Life update: I poured five Tecates into a water bottle and bumping to It Wasn’t Me in a $30 Uber https://t.co/rUn6F1Cizv\n",
      "--\n",
      "934600524174852096\n",
      "@torimccue_ We were legit 12 and feeling broken lmao\n",
      "--\n",
      "934575093061210113\n",
      "Why did I FEEEEEL Lips of an Angel so hard in sixth grade lmao who hurt me????\n",
      "--\n",
      "934565543205658624\n",
      "Sometimes I think I deserve a book deal and then I remember I’m illiterate\n",
      "--\n",
      "934562840345759746\n",
      "I used to go to church and now I can’t even read like wow life is crazy\n",
      "--\n"
     ]
    }
   ],
   "source": [
    "for element in y:\n",
    "    print element['id']\n",
    "    print(element['full_text'])\n",
    "    print('--')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 59,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "una = miner.mine_user_tweets(user=\"una_dab\")\n",
    "amanda = miner.mine_user_tweets(user=\"itsamandaross\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 60,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Also him: “I like ‘Motorsport’”\n",
      "---\n",
      "today my dad told me he “likes that guy Gucci Mane” so I’m gonna go kill myself\n",
      "---\n",
      "how?!??? why??!?? https://t.co/mPnxfsfZjH\n",
      "---\n",
      "trendy!!!!!! https://t.co/xDq403aujt\n",
      "---\n",
      "-@realJoeCalder\n",
      "---\n"
     ]
    }
   ],
   "source": [
    "for x in range(5):\n",
    "    print una[x]['text']\n",
    "    print('---')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 61,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "@internest_the Kim: https://t.co/nTlswKbVuy\n",
      "--\n",
      "@Its_dean @internest_the counterpoint: y'all should just fall in a volcano and die\n",
      "--\n",
      "why is this a promoted tweet on my TL lol https://t.co/lPazdIzhWc\n",
      "--\n",
      "@BomptonBrotha88 honestly yeah youre right i think it's like .025/7\n",
      "--\n",
      "@TracieMorrissey @elenimitzali There's an EIC of the parent company. Eleni and I are the top-line editors at babe that make the final decisions.\n",
      "--\n"
     ]
    }
   ],
   "source": [
    "for x in range(5):\n",
    "    print amanda[x]['text']\n",
    "    print('--')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 62,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>created_at</th>\n",
       "      <th>handle</th>\n",
       "      <th>mined_at</th>\n",
       "      <th>retweet_count</th>\n",
       "      <th>text</th>\n",
       "      <th>tweet_id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Sat Jan 20 02:17:07 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.231974</td>\n",
       "      <td>0</td>\n",
       "      <td>Also him: “I like ‘Motorsport’”</td>\n",
       "      <td>954538246897389568</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Sat Jan 20 02:16:17 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.231991</td>\n",
       "      <td>0</td>\n",
       "      <td>today my dad told me he “likes that guy Gucci ...</td>\n",
       "      <td>954538036657868800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Fri Jan 19 16:25:25 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.231997</td>\n",
       "      <td>0</td>\n",
       "      <td>how?!??? why??!?? https://t.co/mPnxfsfZjH</td>\n",
       "      <td>954389341220102145</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Thu Jan 18 21:36:09 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232002</td>\n",
       "      <td>0</td>\n",
       "      <td>trendy!!!!!! https://t.co/xDq403aujt</td>\n",
       "      <td>954105154340622337</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Wed Jan 17 19:10:11 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232008</td>\n",
       "      <td>0</td>\n",
       "      <td>-@realJoeCalder</td>\n",
       "      <td>953706030256533504</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Wed Jan 17 19:08:14 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232014</td>\n",
       "      <td>0</td>\n",
       "      <td>Seen in a Bushwick bookstore: https://t.co/2zC...</td>\n",
       "      <td>953705538407337985</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Wed Jan 17 12:33:37 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232019</td>\n",
       "      <td>0</td>\n",
       "      <td>Facebook reminds me everyday to never feel THA...</td>\n",
       "      <td>953606233868722176</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Tue Jan 16 18:47:59 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232024</td>\n",
       "      <td>0</td>\n",
       "      <td>NEW content FUN times WOw https://t.co/hwMcE5ZTCy</td>\n",
       "      <td>953338055192207360</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Mon Jan 15 18:27:51 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232028</td>\n",
       "      <td>2</td>\n",
       "      <td>TW/CW: victim-blaming\\nThis is why we need a c...</td>\n",
       "      <td>952970600435331072</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Mon Jan 15 17:20:22 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232033</td>\n",
       "      <td>0</td>\n",
       "      <td>Just a normal day at https://t.co/1o7dzK5Llp!!...</td>\n",
       "      <td>952953619502059520</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>Mon Jan 15 16:16:14 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232038</td>\n",
       "      <td>0</td>\n",
       "      <td>@thecolorhannah Hey Hannah, I'm a writer at @b...</td>\n",
       "      <td>952937480768118785</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Sun Jan 14 20:49:58 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232043</td>\n",
       "      <td>0</td>\n",
       "      <td>@itsamandaross w o w</td>\n",
       "      <td>952643978935095298</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Sun Jan 14 20:12:59 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232047</td>\n",
       "      <td>1</td>\n",
       "      <td>So proud of the @babedotnet team who made this...</td>\n",
       "      <td>952634670788894720</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Sun Jan 14 04:24:30 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232050</td>\n",
       "      <td>12</td>\n",
       "      <td>I don’t know what’s more haunting - reading th...</td>\n",
       "      <td>952395980078448642</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Fri Jan 12 05:47:59 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232055</td>\n",
       "      <td>0</td>\n",
       "      <td>End Game was.... boring. Winking isn’t choreog...</td>\n",
       "      <td>951692211229425664</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Thu Jan 11 20:50:42 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232060</td>\n",
       "      <td>0</td>\n",
       "      <td>Watching Catfish is a constant battle between ...</td>\n",
       "      <td>951556998902046721</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Tue Jan 09 16:30:17 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232065</td>\n",
       "      <td>0</td>\n",
       "      <td>@elenimitzali @babedotnet  https://t.co/PANvFM...</td>\n",
       "      <td>950766687762173952</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Tue Jan 09 04:49:05 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232070</td>\n",
       "      <td>0</td>\n",
       "      <td>Ariana and Camila are both stars!! Cased closed.</td>\n",
       "      <td>950590227294375936</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>Tue Jan 09 04:47:01 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232074</td>\n",
       "      <td>0</td>\n",
       "      <td>Don’t. Pit. Women. Against. Women. https://t.c...</td>\n",
       "      <td>950589705829175296</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>Sun Jan 07 16:48:45 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232079</td>\n",
       "      <td>0</td>\n",
       "      <td>@milesjordan40 Thanks Miles!</td>\n",
       "      <td>950046561387581440</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Sun Jan 07 15:14:27 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232084</td>\n",
       "      <td>0</td>\n",
       "      <td>I’m the first traditional grad in my family an...</td>\n",
       "      <td>950022828228841472</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>Thu Jan 04 04:52:27 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232089</td>\n",
       "      <td>0</td>\n",
       "      <td>2018 is the year we read books and books of no...</td>\n",
       "      <td>948779131445051392</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>Wed Jan 03 19:32:22 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232093</td>\n",
       "      <td>0</td>\n",
       "      <td>@babedotnet @VINNYGUADAGNINO</td>\n",
       "      <td>948638185025884160</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>Wed Dec 27 16:02:41 +0000 2017</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232097</td>\n",
       "      <td>0</td>\n",
       "      <td>@realJoeCalder disclaimer: i do not shop at ho...</td>\n",
       "      <td>946048698974441474</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>Wed Dec 27 15:38:50 +0000 2017</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232102</td>\n",
       "      <td>0</td>\n",
       "      <td>@realJoeCalder is a 24 year old man who is sca...</td>\n",
       "      <td>946042699270033408</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>Sun Dec 24 17:29:35 +0000 2017</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232106</td>\n",
       "      <td>2</td>\n",
       "      <td>Rich kids dealing drugs https://t.co/wNodAWp1iP</td>\n",
       "      <td>944983405900500992</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>Sun Dec 24 02:45:35 +0000 2017</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232111</td>\n",
       "      <td>0</td>\n",
       "      <td>@milesjordan40 Thanks for the respectful convo...</td>\n",
       "      <td>944760941450809344</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>Sun Dec 24 02:43:08 +0000 2017</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232116</td>\n",
       "      <td>0</td>\n",
       "      <td>@milesjordan40 This is a comment about their c...</td>\n",
       "      <td>944760324183461888</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>Sun Dec 24 02:38:29 +0000 2017</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232121</td>\n",
       "      <td>0</td>\n",
       "      <td>@milesjordan40 Just seems like you’re blaming ...</td>\n",
       "      <td>944759151946760192</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>Sun Dec 24 02:36:47 +0000 2017</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.232126</td>\n",
       "      <td>0</td>\n",
       "      <td>@milesjordan40 Just trying to speak up when I ...</td>\n",
       "      <td>944758723406450690</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>989</th>\n",
       "      <td>Fri Nov 07 03:49:12 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185712</td>\n",
       "      <td>0</td>\n",
       "      <td>@ashlyn_carey best colbie song ever</td>\n",
       "      <td>530567618353459200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>990</th>\n",
       "      <td>Fri Nov 07 00:17:19 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185725</td>\n",
       "      <td>0</td>\n",
       "      <td>“@chanelpuke: Idk I think feminism should be c...</td>\n",
       "      <td>530514296162500609</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>991</th>\n",
       "      <td>Fri Nov 07 00:16:27 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185730</td>\n",
       "      <td>1</td>\n",
       "      <td>take time to realize that I'm on your side</td>\n",
       "      <td>530514078616551426</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>992</th>\n",
       "      <td>Wed Nov 05 04:34:59 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185735</td>\n",
       "      <td>0</td>\n",
       "      <td>officially moving to Washington DC</td>\n",
       "      <td>529854366514446336</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>993</th>\n",
       "      <td>Tue Nov 04 22:46:15 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185739</td>\n",
       "      <td>0</td>\n",
       "      <td>Hope everyone voted for Leslie Knope today</td>\n",
       "      <td>529766603513413633</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>994</th>\n",
       "      <td>Tue Nov 04 08:38:45 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185744</td>\n",
       "      <td>0</td>\n",
       "      <td>I can't sleep http://t.co/MN6W13fzaU</td>\n",
       "      <td>529553324329406464</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>995</th>\n",
       "      <td>Tue Nov 04 06:22:44 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185748</td>\n",
       "      <td>0</td>\n",
       "      <td>life goals: Melbourne horse races</td>\n",
       "      <td>529519091657482240</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>996</th>\n",
       "      <td>Sun Nov 02 21:08:51 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185753</td>\n",
       "      <td>0</td>\n",
       "      <td>\"Una you should use baby powder as foundation\"...</td>\n",
       "      <td>529017315644694528</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>997</th>\n",
       "      <td>Sun Nov 02 06:38:33 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185757</td>\n",
       "      <td>0</td>\n",
       "      <td>All work and no play makes jack a dull boy</td>\n",
       "      <td>528798296543084544</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>998</th>\n",
       "      <td>Fri Oct 31 16:22:48 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185760</td>\n",
       "      <td>2</td>\n",
       "      <td>Please don't make fun of Amanda Bynes. Someone...</td>\n",
       "      <td>528220555510808576</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>999</th>\n",
       "      <td>Thu Oct 30 05:06:16 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185764</td>\n",
       "      <td>0</td>\n",
       "      <td>@hannahscruggs_ I'm glad you love it! Haha I h...</td>\n",
       "      <td>527687912528568320</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1000</th>\n",
       "      <td>Thu Oct 30 04:08:19 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185769</td>\n",
       "      <td>0</td>\n",
       "      <td>\"Rick Ross is my sugardaddy\" \"he might eat all...</td>\n",
       "      <td>527673328795152384</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1001</th>\n",
       "      <td>Wed Oct 29 18:45:35 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185773</td>\n",
       "      <td>0</td>\n",
       "      <td>I'm wearing shorts and sandals on October 29th...</td>\n",
       "      <td>527531711215988737</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1002</th>\n",
       "      <td>Tue Oct 28 05:51:11 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185777</td>\n",
       "      <td>0</td>\n",
       "      <td>@Danny_OG7 never!</td>\n",
       "      <td>526974439460962304</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1003</th>\n",
       "      <td>Tue Oct 28 04:56:31 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185782</td>\n",
       "      <td>0</td>\n",
       "      <td>ok chris pine can marry me now</td>\n",
       "      <td>526960680872996864</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1004</th>\n",
       "      <td>Mon Oct 27 06:02:14 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185785</td>\n",
       "      <td>1</td>\n",
       "      <td>say you'll remember me standing in a nice dres...</td>\n",
       "      <td>526614832855142400</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1005</th>\n",
       "      <td>Mon Oct 27 05:47:28 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185789</td>\n",
       "      <td>0</td>\n",
       "      <td>nightmare dressed as a daydream</td>\n",
       "      <td>526611115527393280</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1006</th>\n",
       "      <td>Tue Oct 21 03:39:33 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185793</td>\n",
       "      <td>0</td>\n",
       "      <td>\"You should be cocaine for Halloween\" ok I kno...</td>\n",
       "      <td>524404595607736321</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1007</th>\n",
       "      <td>Sun Oct 19 05:30:51 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185798</td>\n",
       "      <td>0</td>\n",
       "      <td>Just saw a female fistfight at cookout-- my li...</td>\n",
       "      <td>523707831347060737</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1008</th>\n",
       "      <td>Sat Oct 18 21:27:13 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185802</td>\n",
       "      <td>0</td>\n",
       "      <td>My dad just ran over Patricks phone with the c...</td>\n",
       "      <td>523586122178637824</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1009</th>\n",
       "      <td>Thu Oct 16 18:02:36 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185806</td>\n",
       "      <td>0</td>\n",
       "      <td>Showering at home was a religious experience</td>\n",
       "      <td>522809852666843136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1010</th>\n",
       "      <td>Wed Oct 15 20:43:43 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185810</td>\n",
       "      <td>0</td>\n",
       "      <td>A year ago today I sent in my application for ...</td>\n",
       "      <td>522488011465179136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1011</th>\n",
       "      <td>Wed Oct 15 01:33:13 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185815</td>\n",
       "      <td>0</td>\n",
       "      <td>Ain't no hollaback girl 💁</td>\n",
       "      <td>522198476139266049</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1012</th>\n",
       "      <td>Tue Oct 14 20:41:33 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185818</td>\n",
       "      <td>2</td>\n",
       "      <td>don’t date anyone who doesn’t want to hear you...</td>\n",
       "      <td>522125074619695104</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1013</th>\n",
       "      <td>Tue Oct 14 03:34:36 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185822</td>\n",
       "      <td>0</td>\n",
       "      <td>Trying to explain how we have been best friend...</td>\n",
       "      <td>521866636283117568</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1014</th>\n",
       "      <td>Tue Oct 14 03:32:46 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185826</td>\n",
       "      <td>0</td>\n",
       "      <td>Sheila and I currently have three conversation...</td>\n",
       "      <td>521866173332598784</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1015</th>\n",
       "      <td>Fri Oct 10 23:52:50 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185830</td>\n",
       "      <td>0</td>\n",
       "      <td>North Carolina just got a little more beautifu...</td>\n",
       "      <td>520723664804012032</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1016</th>\n",
       "      <td>Fri Oct 10 21:46:04 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185833</td>\n",
       "      <td>2</td>\n",
       "      <td>When I don't get retweets on golden tweets htt...</td>\n",
       "      <td>520691759979175937</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1017</th>\n",
       "      <td>Fri Oct 10 04:44:14 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185837</td>\n",
       "      <td>1</td>\n",
       "      <td>Killing me softlyy 💋</td>\n",
       "      <td>520434609012887552</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1018</th>\n",
       "      <td>Thu Oct 09 14:52:12 +0000 2014</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:48.185841</td>\n",
       "      <td>0</td>\n",
       "      <td>I know you're looking for salvation in the sec...</td>\n",
       "      <td>520225220675006464</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>1019 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                          created_at   handle                   mined_at  \\\n",
       "0     Sat Jan 20 02:17:07 +0000 2018  una_dab 2018-01-20 01:56:42.231974   \n",
       "1     Sat Jan 20 02:16:17 +0000 2018  una_dab 2018-01-20 01:56:42.231991   \n",
       "2     Fri Jan 19 16:25:25 +0000 2018  una_dab 2018-01-20 01:56:42.231997   \n",
       "3     Thu Jan 18 21:36:09 +0000 2018  una_dab 2018-01-20 01:56:42.232002   \n",
       "4     Wed Jan 17 19:10:11 +0000 2018  una_dab 2018-01-20 01:56:42.232008   \n",
       "5     Wed Jan 17 19:08:14 +0000 2018  una_dab 2018-01-20 01:56:42.232014   \n",
       "6     Wed Jan 17 12:33:37 +0000 2018  una_dab 2018-01-20 01:56:42.232019   \n",
       "7     Tue Jan 16 18:47:59 +0000 2018  una_dab 2018-01-20 01:56:42.232024   \n",
       "8     Mon Jan 15 18:27:51 +0000 2018  una_dab 2018-01-20 01:56:42.232028   \n",
       "9     Mon Jan 15 17:20:22 +0000 2018  una_dab 2018-01-20 01:56:42.232033   \n",
       "10    Mon Jan 15 16:16:14 +0000 2018  una_dab 2018-01-20 01:56:42.232038   \n",
       "11    Sun Jan 14 20:49:58 +0000 2018  una_dab 2018-01-20 01:56:42.232043   \n",
       "12    Sun Jan 14 20:12:59 +0000 2018  una_dab 2018-01-20 01:56:42.232047   \n",
       "13    Sun Jan 14 04:24:30 +0000 2018  una_dab 2018-01-20 01:56:42.232050   \n",
       "14    Fri Jan 12 05:47:59 +0000 2018  una_dab 2018-01-20 01:56:42.232055   \n",
       "15    Thu Jan 11 20:50:42 +0000 2018  una_dab 2018-01-20 01:56:42.232060   \n",
       "16    Tue Jan 09 16:30:17 +0000 2018  una_dab 2018-01-20 01:56:42.232065   \n",
       "17    Tue Jan 09 04:49:05 +0000 2018  una_dab 2018-01-20 01:56:42.232070   \n",
       "18    Tue Jan 09 04:47:01 +0000 2018  una_dab 2018-01-20 01:56:42.232074   \n",
       "19    Sun Jan 07 16:48:45 +0000 2018  una_dab 2018-01-20 01:56:42.232079   \n",
       "20    Sun Jan 07 15:14:27 +0000 2018  una_dab 2018-01-20 01:56:42.232084   \n",
       "21    Thu Jan 04 04:52:27 +0000 2018  una_dab 2018-01-20 01:56:42.232089   \n",
       "22    Wed Jan 03 19:32:22 +0000 2018  una_dab 2018-01-20 01:56:42.232093   \n",
       "23    Wed Dec 27 16:02:41 +0000 2017  una_dab 2018-01-20 01:56:42.232097   \n",
       "24    Wed Dec 27 15:38:50 +0000 2017  una_dab 2018-01-20 01:56:42.232102   \n",
       "25    Sun Dec 24 17:29:35 +0000 2017  una_dab 2018-01-20 01:56:42.232106   \n",
       "26    Sun Dec 24 02:45:35 +0000 2017  una_dab 2018-01-20 01:56:42.232111   \n",
       "27    Sun Dec 24 02:43:08 +0000 2017  una_dab 2018-01-20 01:56:42.232116   \n",
       "28    Sun Dec 24 02:38:29 +0000 2017  una_dab 2018-01-20 01:56:42.232121   \n",
       "29    Sun Dec 24 02:36:47 +0000 2017  una_dab 2018-01-20 01:56:42.232126   \n",
       "...                              ...      ...                        ...   \n",
       "989   Fri Nov 07 03:49:12 +0000 2014  una_dab 2018-01-20 01:56:48.185712   \n",
       "990   Fri Nov 07 00:17:19 +0000 2014  una_dab 2018-01-20 01:56:48.185725   \n",
       "991   Fri Nov 07 00:16:27 +0000 2014  una_dab 2018-01-20 01:56:48.185730   \n",
       "992   Wed Nov 05 04:34:59 +0000 2014  una_dab 2018-01-20 01:56:48.185735   \n",
       "993   Tue Nov 04 22:46:15 +0000 2014  una_dab 2018-01-20 01:56:48.185739   \n",
       "994   Tue Nov 04 08:38:45 +0000 2014  una_dab 2018-01-20 01:56:48.185744   \n",
       "995   Tue Nov 04 06:22:44 +0000 2014  una_dab 2018-01-20 01:56:48.185748   \n",
       "996   Sun Nov 02 21:08:51 +0000 2014  una_dab 2018-01-20 01:56:48.185753   \n",
       "997   Sun Nov 02 06:38:33 +0000 2014  una_dab 2018-01-20 01:56:48.185757   \n",
       "998   Fri Oct 31 16:22:48 +0000 2014  una_dab 2018-01-20 01:56:48.185760   \n",
       "999   Thu Oct 30 05:06:16 +0000 2014  una_dab 2018-01-20 01:56:48.185764   \n",
       "1000  Thu Oct 30 04:08:19 +0000 2014  una_dab 2018-01-20 01:56:48.185769   \n",
       "1001  Wed Oct 29 18:45:35 +0000 2014  una_dab 2018-01-20 01:56:48.185773   \n",
       "1002  Tue Oct 28 05:51:11 +0000 2014  una_dab 2018-01-20 01:56:48.185777   \n",
       "1003  Tue Oct 28 04:56:31 +0000 2014  una_dab 2018-01-20 01:56:48.185782   \n",
       "1004  Mon Oct 27 06:02:14 +0000 2014  una_dab 2018-01-20 01:56:48.185785   \n",
       "1005  Mon Oct 27 05:47:28 +0000 2014  una_dab 2018-01-20 01:56:48.185789   \n",
       "1006  Tue Oct 21 03:39:33 +0000 2014  una_dab 2018-01-20 01:56:48.185793   \n",
       "1007  Sun Oct 19 05:30:51 +0000 2014  una_dab 2018-01-20 01:56:48.185798   \n",
       "1008  Sat Oct 18 21:27:13 +0000 2014  una_dab 2018-01-20 01:56:48.185802   \n",
       "1009  Thu Oct 16 18:02:36 +0000 2014  una_dab 2018-01-20 01:56:48.185806   \n",
       "1010  Wed Oct 15 20:43:43 +0000 2014  una_dab 2018-01-20 01:56:48.185810   \n",
       "1011  Wed Oct 15 01:33:13 +0000 2014  una_dab 2018-01-20 01:56:48.185815   \n",
       "1012  Tue Oct 14 20:41:33 +0000 2014  una_dab 2018-01-20 01:56:48.185818   \n",
       "1013  Tue Oct 14 03:34:36 +0000 2014  una_dab 2018-01-20 01:56:48.185822   \n",
       "1014  Tue Oct 14 03:32:46 +0000 2014  una_dab 2018-01-20 01:56:48.185826   \n",
       "1015  Fri Oct 10 23:52:50 +0000 2014  una_dab 2018-01-20 01:56:48.185830   \n",
       "1016  Fri Oct 10 21:46:04 +0000 2014  una_dab 2018-01-20 01:56:48.185833   \n",
       "1017  Fri Oct 10 04:44:14 +0000 2014  una_dab 2018-01-20 01:56:48.185837   \n",
       "1018  Thu Oct 09 14:52:12 +0000 2014  una_dab 2018-01-20 01:56:48.185841   \n",
       "\n",
       "      retweet_count                                               text  \\\n",
       "0                 0                    Also him: “I like ‘Motorsport’”   \n",
       "1                 0  today my dad told me he “likes that guy Gucci ...   \n",
       "2                 0          how?!??? why??!?? https://t.co/mPnxfsfZjH   \n",
       "3                 0               trendy!!!!!! https://t.co/xDq403aujt   \n",
       "4                 0                                    -@realJoeCalder   \n",
       "5                 0  Seen in a Bushwick bookstore: https://t.co/2zC...   \n",
       "6                 0  Facebook reminds me everyday to never feel THA...   \n",
       "7                 0  NEW content FUN times WOw https://t.co/hwMcE5ZTCy   \n",
       "8                 2  TW/CW: victim-blaming\\nThis is why we need a c...   \n",
       "9                 0  Just a normal day at https://t.co/1o7dzK5Llp!!...   \n",
       "10                0  @thecolorhannah Hey Hannah, I'm a writer at @b...   \n",
       "11                0                               @itsamandaross w o w   \n",
       "12                1  So proud of the @babedotnet team who made this...   \n",
       "13               12  I don’t know what’s more haunting - reading th...   \n",
       "14                0  End Game was.... boring. Winking isn’t choreog...   \n",
       "15                0  Watching Catfish is a constant battle between ...   \n",
       "16                0  @elenimitzali @babedotnet  https://t.co/PANvFM...   \n",
       "17                0   Ariana and Camila are both stars!! Cased closed.   \n",
       "18                0  Don’t. Pit. Women. Against. Women. https://t.c...   \n",
       "19                0                       @milesjordan40 Thanks Miles!   \n",
       "20                0  I’m the first traditional grad in my family an...   \n",
       "21                0  2018 is the year we read books and books of no...   \n",
       "22                0                       @babedotnet @VINNYGUADAGNINO   \n",
       "23                0  @realJoeCalder disclaimer: i do not shop at ho...   \n",
       "24                0  @realJoeCalder is a 24 year old man who is sca...   \n",
       "25                2    Rich kids dealing drugs https://t.co/wNodAWp1iP   \n",
       "26                0  @milesjordan40 Thanks for the respectful convo...   \n",
       "27                0  @milesjordan40 This is a comment about their c...   \n",
       "28                0  @milesjordan40 Just seems like you’re blaming ...   \n",
       "29                0  @milesjordan40 Just trying to speak up when I ...   \n",
       "...             ...                                                ...   \n",
       "989               0                @ashlyn_carey best colbie song ever   \n",
       "990               0  “@chanelpuke: Idk I think feminism should be c...   \n",
       "991               1         take time to realize that I'm on your side   \n",
       "992               0                 officially moving to Washington DC   \n",
       "993               0         Hope everyone voted for Leslie Knope today   \n",
       "994               0               I can't sleep http://t.co/MN6W13fzaU   \n",
       "995               0                  life goals: Melbourne horse races   \n",
       "996               0  \"Una you should use baby powder as foundation\"...   \n",
       "997               0         All work and no play makes jack a dull boy   \n",
       "998               2  Please don't make fun of Amanda Bynes. Someone...   \n",
       "999               0  @hannahscruggs_ I'm glad you love it! Haha I h...   \n",
       "1000              0  \"Rick Ross is my sugardaddy\" \"he might eat all...   \n",
       "1001              0  I'm wearing shorts and sandals on October 29th...   \n",
       "1002              0                                  @Danny_OG7 never!   \n",
       "1003              0                     ok chris pine can marry me now   \n",
       "1004              1  say you'll remember me standing in a nice dres...   \n",
       "1005              0                    nightmare dressed as a daydream   \n",
       "1006              0  \"You should be cocaine for Halloween\" ok I kno...   \n",
       "1007              0  Just saw a female fistfight at cookout-- my li...   \n",
       "1008              0  My dad just ran over Patricks phone with the c...   \n",
       "1009              0       Showering at home was a religious experience   \n",
       "1010              0  A year ago today I sent in my application for ...   \n",
       "1011              0                         Ain't no hollaback girl 💁   \n",
       "1012              2  don’t date anyone who doesn’t want to hear you...   \n",
       "1013              0  Trying to explain how we have been best friend...   \n",
       "1014              0  Sheila and I currently have three conversation...   \n",
       "1015              0  North Carolina just got a little more beautifu...   \n",
       "1016              2  When I don't get retweets on golden tweets htt...   \n",
       "1017              1                              Killing me softlyy 💋   \n",
       "1018              0  I know you're looking for salvation in the sec...   \n",
       "\n",
       "                tweet_id  \n",
       "0     954538246897389568  \n",
       "1     954538036657868800  \n",
       "2     954389341220102145  \n",
       "3     954105154340622337  \n",
       "4     953706030256533504  \n",
       "5     953705538407337985  \n",
       "6     953606233868722176  \n",
       "7     953338055192207360  \n",
       "8     952970600435331072  \n",
       "9     952953619502059520  \n",
       "10    952937480768118785  \n",
       "11    952643978935095298  \n",
       "12    952634670788894720  \n",
       "13    952395980078448642  \n",
       "14    951692211229425664  \n",
       "15    951556998902046721  \n",
       "16    950766687762173952  \n",
       "17    950590227294375936  \n",
       "18    950589705829175296  \n",
       "19    950046561387581440  \n",
       "20    950022828228841472  \n",
       "21    948779131445051392  \n",
       "22    948638185025884160  \n",
       "23    946048698974441474  \n",
       "24    946042699270033408  \n",
       "25    944983405900500992  \n",
       "26    944760941450809344  \n",
       "27    944760324183461888  \n",
       "28    944759151946760192  \n",
       "29    944758723406450690  \n",
       "...                  ...  \n",
       "989   530567618353459200  \n",
       "990   530514296162500609  \n",
       "991   530514078616551426  \n",
       "992   529854366514446336  \n",
       "993   529766603513413633  \n",
       "994   529553324329406464  \n",
       "995   529519091657482240  \n",
       "996   529017315644694528  \n",
       "997   528798296543084544  \n",
       "998   528220555510808576  \n",
       "999   527687912528568320  \n",
       "1000  527673328795152384  \n",
       "1001  527531711215988737  \n",
       "1002  526974439460962304  \n",
       "1003  526960680872996864  \n",
       "1004  526614832855142400  \n",
       "1005  526611115527393280  \n",
       "1006  524404595607736321  \n",
       "1007  523707831347060737  \n",
       "1008  523586122178637824  \n",
       "1009  522809852666843136  \n",
       "1010  522488011465179136  \n",
       "1011  522198476139266049  \n",
       "1012  522125074619695104  \n",
       "1013  521866636283117568  \n",
       "1014  521866173332598784  \n",
       "1015  520723664804012032  \n",
       "1016  520691759979175937  \n",
       "1017  520434609012887552  \n",
       "1018  520225220675006464  \n",
       "\n",
       "[1019 rows x 6 columns]"
      ]
     },
     "execution_count": 62,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "una_tweets = pd.DataFrame(una)\n",
    "una_tweets"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>created_at</th>\n",
       "      <th>handle</th>\n",
       "      <th>mined_at</th>\n",
       "      <th>retweet_count</th>\n",
       "      <th>text</th>\n",
       "      <th>tweet_id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Thu Jan 18 22:00:47 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213123</td>\n",
       "      <td>0</td>\n",
       "      <td>@internest_the Kim: https://t.co/nTlswKbVuy</td>\n",
       "      <td>954111353911988224</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Thu Jan 18 17:09:19 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213143</td>\n",
       "      <td>0</td>\n",
       "      <td>@Its_dean @internest_the counterpoint: y'all s...</td>\n",
       "      <td>954038001914572800</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Thu Jan 18 15:12:56 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213150</td>\n",
       "      <td>0</td>\n",
       "      <td>why is this a promoted tweet on my TL lol http...</td>\n",
       "      <td>954008713030963200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Thu Jan 18 15:07:49 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213155</td>\n",
       "      <td>1</td>\n",
       "      <td>@BomptonBrotha88 honestly yeah youre right i t...</td>\n",
       "      <td>954007425899814913</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Wed Jan 17 14:56:46 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213161</td>\n",
       "      <td>0</td>\n",
       "      <td>@TracieMorrissey @elenimitzali There's an EIC ...</td>\n",
       "      <td>953642258305376257</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Tue Jan 16 14:00:48 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213167</td>\n",
       "      <td>2</td>\n",
       "      <td>Third world men? Aziz was born in South Caroli...</td>\n",
       "      <td>953265784880541701</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Tue Jan 16 02:48:42 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213172</td>\n",
       "      <td>1</td>\n",
       "      <td>The rumors are NOT true! I don’t like to suck ...</td>\n",
       "      <td>953096644400214017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Tue Jan 16 02:45:26 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213178</td>\n",
       "      <td>0</td>\n",
       "      <td>What if god was one of us https://t.co/IQ3BM0oKPC</td>\n",
       "      <td>953095822455005185</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Tue Jan 16 00:19:51 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213183</td>\n",
       "      <td>1</td>\n",
       "      <td>“You mean you can’t chase a woman around the r...</td>\n",
       "      <td>953059187654889474</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Mon Jan 15 20:09:20 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213189</td>\n",
       "      <td>0</td>\n",
       "      <td>@JNkappers Lemme help https://t.co/fIUTY7MrzA</td>\n",
       "      <td>952996141863526401</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>Mon Jan 15 16:53:51 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213193</td>\n",
       "      <td>4</td>\n",
       "      <td>“Well if THAT’S sexual assault then lock me up...</td>\n",
       "      <td>952946947362607105</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Mon Jan 15 16:47:31 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213199</td>\n",
       "      <td>0</td>\n",
       "      <td>@annalikestweets The world wasn’t ready for a ...</td>\n",
       "      <td>952945353950662656</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Mon Jan 15 15:46:37 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213204</td>\n",
       "      <td>0</td>\n",
       "      <td>@juleslasaslvia @JillFilipovic  https://t.co/m...</td>\n",
       "      <td>952930025812189185</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Mon Jan 15 02:49:57 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213208</td>\n",
       "      <td>1</td>\n",
       "      <td>https://t.co/iAMxAQmHYc</td>\n",
       "      <td>952734573431017472</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Sun Jan 14 23:43:38 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213214</td>\n",
       "      <td>0</td>\n",
       "      <td>@currency_kitten I’m good with the media-speci...</td>\n",
       "      <td>952687683767238656</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Sun Jan 14 20:53:17 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213219</td>\n",
       "      <td>0</td>\n",
       "      <td>@MyAlteredEgo Would be happy discus this if yo...</td>\n",
       "      <td>952644813391826944</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Sun Jan 14 20:50:35 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213225</td>\n",
       "      <td>0</td>\n",
       "      <td>@MyAlteredEgo We were told a story in the publ...</td>\n",
       "      <td>952644135365890048</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Sun Jan 14 20:45:27 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213231</td>\n",
       "      <td>0</td>\n",
       "      <td>@MyAlteredEgo Yes, it’s an accepted, common an...</td>\n",
       "      <td>952642841687273472</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>Sun Jan 14 20:35:17 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213237</td>\n",
       "      <td>0</td>\n",
       "      <td>@_hannah_tomes Right? Like thanks for saying I...</td>\n",
       "      <td>952640284621492226</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>Sun Jan 14 20:32:32 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213241</td>\n",
       "      <td>1</td>\n",
       "      <td>@MyAlteredEgo We repeatedly called and email s...</td>\n",
       "      <td>952639592603226112</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Sun Jan 14 20:30:36 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213245</td>\n",
       "      <td>6</td>\n",
       "      <td>Guy sends me a link to a forum thread in which...</td>\n",
       "      <td>952639106772815873</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>Sun Jan 14 19:56:24 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213251</td>\n",
       "      <td>0</td>\n",
       "      <td>@HeadCaseLifeNYC Oh you mean like this? https:...</td>\n",
       "      <td>952630500333678595</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>Sun Jan 14 18:48:05 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213256</td>\n",
       "      <td>1</td>\n",
       "      <td>This thread (last tweet!) is not to argue  abo...</td>\n",
       "      <td>952613304781983745</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>Sun Jan 14 18:44:37 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213260</td>\n",
       "      <td>3</td>\n",
       "      <td>As the editor of @babedotnet, I’m not a judge,...</td>\n",
       "      <td>952612434958831618</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>Sun Jan 14 18:41:51 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213265</td>\n",
       "      <td>1</td>\n",
       "      <td>We had no reason to believe so. Aziz has the c...</td>\n",
       "      <td>952611739010523136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>Sun Jan 14 18:39:08 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213269</td>\n",
       "      <td>2</td>\n",
       "      <td>Especially when a source wants to say anonymou...</td>\n",
       "      <td>952611054588227584</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>Sun Jan 14 18:37:06 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213274</td>\n",
       "      <td>0</td>\n",
       "      <td>The incredible @k80way did the bulk of the wor...</td>\n",
       "      <td>952610542472048640</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>Sun Jan 14 18:34:19 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213279</td>\n",
       "      <td>1</td>\n",
       "      <td>We had meeting after meeting in which we discu...</td>\n",
       "      <td>952609841717170176</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>Sun Jan 14 18:31:41 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213283</td>\n",
       "      <td>3</td>\n",
       "      <td>-We reached out to several members of Aziz’s t...</td>\n",
       "      <td>952609177402335233</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>Sun Jan 14 18:29:13 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213288</td>\n",
       "      <td>12</td>\n",
       "      <td>-Read every text she sent to her friends that ...</td>\n",
       "      <td>952608559350591489</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1633</th>\n",
       "      <td>Tue Jan 24 02:11:32 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224317</td>\n",
       "      <td>0</td>\n",
       "      <td>Wholesome TX memes https://t.co/fteZ7CjWxY</td>\n",
       "      <td>823714825482158080</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1634</th>\n",
       "      <td>Sun Jan 22 21:20:36 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224322</td>\n",
       "      <td>0</td>\n",
       "      <td>Why do I only hang out w janky ass people http...</td>\n",
       "      <td>823279219677466625</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1635</th>\n",
       "      <td>Sun Jan 22 18:05:34 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224327</td>\n",
       "      <td>0</td>\n",
       "      <td>@LesleyVWarren good, we need to punish them all</td>\n",
       "      <td>823230137986646019</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1636</th>\n",
       "      <td>Sun Jan 22 17:11:17 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224332</td>\n",
       "      <td>0</td>\n",
       "      <td>tag yourself, i'm a bratty emo money lover htt...</td>\n",
       "      <td>823216478757470208</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1637</th>\n",
       "      <td>Sun Jan 22 14:55:31 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224337</td>\n",
       "      <td>0</td>\n",
       "      <td>Friendly bodega guys make the world go round</td>\n",
       "      <td>823182311751634944</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1638</th>\n",
       "      <td>Sat Jan 21 23:15:34 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224342</td>\n",
       "      <td>0</td>\n",
       "      <td>@Mr_Rumpels oooooh buuurn https://t.co/wCLZM1Nf6E</td>\n",
       "      <td>822945765916086274</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1639</th>\n",
       "      <td>Sat Jan 21 22:23:58 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224348</td>\n",
       "      <td>0</td>\n",
       "      <td>Cats like plain crisps</td>\n",
       "      <td>822932779730169856</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1640</th>\n",
       "      <td>Sat Jan 21 14:20:31 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224353</td>\n",
       "      <td>0</td>\n",
       "      <td>There is a v palpable energy to today and I ha...</td>\n",
       "      <td>822811116095045633</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1641</th>\n",
       "      <td>Sat Jan 21 11:08:58 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224358</td>\n",
       "      <td>0</td>\n",
       "      <td>Ya, it's just science  https://t.co/5EDhfkB0Vf</td>\n",
       "      <td>822762910019620864</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1642</th>\n",
       "      <td>Sat Jan 21 10:35:35 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224362</td>\n",
       "      <td>0</td>\n",
       "      <td>WHAT DO MY DREAMS MEAN, HELP ME UNIVERSE 😩 ht...</td>\n",
       "      <td>822754509357285377</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1643</th>\n",
       "      <td>Sat Jan 21 10:32:46 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224367</td>\n",
       "      <td>0</td>\n",
       "      <td>Just dreamt I got told off at work so hard I s...</td>\n",
       "      <td>822753800251461632</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1644</th>\n",
       "      <td>Sat Jan 21 05:13:01 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224371</td>\n",
       "      <td>1</td>\n",
       "      <td>Big mood ⚡️ https://t.co/1FcHpjQL9V</td>\n",
       "      <td>822673332969635840</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1645</th>\n",
       "      <td>Sat Jan 21 05:08:36 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224376</td>\n",
       "      <td>0</td>\n",
       "      <td>Ooooh well done, Austin TX ⭐ https://t.co/GTOA...</td>\n",
       "      <td>822672221822943234</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1646</th>\n",
       "      <td>Sat Jan 21 03:41:01 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224380</td>\n",
       "      <td>3</td>\n",
       "      <td>@RichardBSpencer @draknats Truly an American h...</td>\n",
       "      <td>822650180050763776</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1647</th>\n",
       "      <td>Sat Jan 21 03:39:01 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224386</td>\n",
       "      <td>0</td>\n",
       "      <td>Hey @RichardBSpencer come to Harlem so I can b...</td>\n",
       "      <td>822649675933249539</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1648</th>\n",
       "      <td>Sat Jan 21 03:15:07 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224390</td>\n",
       "      <td>1</td>\n",
       "      <td>THIS IS MELANIA TRUMP'S REAL TWITTER BANNER IM...</td>\n",
       "      <td>822643660315619334</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1649</th>\n",
       "      <td>Sat Jan 21 00:34:29 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224395</td>\n",
       "      <td>0</td>\n",
       "      <td>KNUCK IF U BUCK, BITCH https://t.co/q1XzZKh3Xs</td>\n",
       "      <td>822603234921562113</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1650</th>\n",
       "      <td>Sat Jan 21 00:15:30 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224400</td>\n",
       "      <td>0</td>\n",
       "      <td>dad come back we miss u :( https://t.co/gYsdx7...</td>\n",
       "      <td>822598457290616832</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1651</th>\n",
       "      <td>Fri Jan 20 22:07:05 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224404</td>\n",
       "      <td>3</td>\n",
       "      <td>Awesome footage of D.C. cops pepper spraying s...</td>\n",
       "      <td>822566141658824704</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1652</th>\n",
       "      <td>Fri Jan 20 03:35:22 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224410</td>\n",
       "      <td>0</td>\n",
       "      <td>The Slenderman documentary is out this Monday!...</td>\n",
       "      <td>822286369267519492</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1653</th>\n",
       "      <td>Fri Jan 20 02:50:17 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224414</td>\n",
       "      <td>0</td>\n",
       "      <td>TBT to when I left the Louvre after 45 minutes...</td>\n",
       "      <td>822275025537474560</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1654</th>\n",
       "      <td>Fri Jan 20 01:50:13 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224419</td>\n",
       "      <td>2</td>\n",
       "      <td>Honestly I would just be the cutest wife</td>\n",
       "      <td>822259908280205312</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1655</th>\n",
       "      <td>Fri Jan 20 01:22:17 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224423</td>\n",
       "      <td>1</td>\n",
       "      <td>Andy's post-makeover fashion montage in The De...</td>\n",
       "      <td>822252876412162048</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1656</th>\n",
       "      <td>Thu Jan 19 20:25:59 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224427</td>\n",
       "      <td>0</td>\n",
       "      <td>can’t wait to make my next small beauty purcha...</td>\n",
       "      <td>822178311338160129</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1657</th>\n",
       "      <td>Thu Jan 19 15:54:49 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224433</td>\n",
       "      <td>0</td>\n",
       "      <td>Had a nightmare that I was boarding a plane to...</td>\n",
       "      <td>822110068728532993</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1658</th>\n",
       "      <td>Thu Jan 19 01:52:48 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224438</td>\n",
       "      <td>0</td>\n",
       "      <td>Worst part of being sick is feeling useless tbh</td>\n",
       "      <td>821898168417878016</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1659</th>\n",
       "      <td>Wed Jan 18 20:27:02 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224443</td>\n",
       "      <td>0</td>\n",
       "      <td>Worse 😊😊😊 https://t.co/ZfbMq4mTYL</td>\n",
       "      <td>821816187369623553</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1660</th>\n",
       "      <td>Wed Jan 18 20:01:38 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224448</td>\n",
       "      <td>0</td>\n",
       "      <td>Deadly combo of cough medicine, Real Housewive...</td>\n",
       "      <td>821809794491224064</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1661</th>\n",
       "      <td>Wed Jan 18 14:27:00 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224453</td>\n",
       "      <td>0</td>\n",
       "      <td>Will this hydrocodone cough syrup make me a be...</td>\n",
       "      <td>821725582480338944</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1662</th>\n",
       "      <td>Tue Jan 17 12:42:15 +0000 2017</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:55.224458</td>\n",
       "      <td>0</td>\n",
       "      <td>@szangani https://t.co/EFCeQMnpRc</td>\n",
       "      <td>821336835188228096</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>1663 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                          created_at         handle  \\\n",
       "0     Thu Jan 18 22:00:47 +0000 2018  itsamandaross   \n",
       "1     Thu Jan 18 17:09:19 +0000 2018  itsamandaross   \n",
       "2     Thu Jan 18 15:12:56 +0000 2018  itsamandaross   \n",
       "3     Thu Jan 18 15:07:49 +0000 2018  itsamandaross   \n",
       "4     Wed Jan 17 14:56:46 +0000 2018  itsamandaross   \n",
       "5     Tue Jan 16 14:00:48 +0000 2018  itsamandaross   \n",
       "6     Tue Jan 16 02:48:42 +0000 2018  itsamandaross   \n",
       "7     Tue Jan 16 02:45:26 +0000 2018  itsamandaross   \n",
       "8     Tue Jan 16 00:19:51 +0000 2018  itsamandaross   \n",
       "9     Mon Jan 15 20:09:20 +0000 2018  itsamandaross   \n",
       "10    Mon Jan 15 16:53:51 +0000 2018  itsamandaross   \n",
       "11    Mon Jan 15 16:47:31 +0000 2018  itsamandaross   \n",
       "12    Mon Jan 15 15:46:37 +0000 2018  itsamandaross   \n",
       "13    Mon Jan 15 02:49:57 +0000 2018  itsamandaross   \n",
       "14    Sun Jan 14 23:43:38 +0000 2018  itsamandaross   \n",
       "15    Sun Jan 14 20:53:17 +0000 2018  itsamandaross   \n",
       "16    Sun Jan 14 20:50:35 +0000 2018  itsamandaross   \n",
       "17    Sun Jan 14 20:45:27 +0000 2018  itsamandaross   \n",
       "18    Sun Jan 14 20:35:17 +0000 2018  itsamandaross   \n",
       "19    Sun Jan 14 20:32:32 +0000 2018  itsamandaross   \n",
       "20    Sun Jan 14 20:30:36 +0000 2018  itsamandaross   \n",
       "21    Sun Jan 14 19:56:24 +0000 2018  itsamandaross   \n",
       "22    Sun Jan 14 18:48:05 +0000 2018  itsamandaross   \n",
       "23    Sun Jan 14 18:44:37 +0000 2018  itsamandaross   \n",
       "24    Sun Jan 14 18:41:51 +0000 2018  itsamandaross   \n",
       "25    Sun Jan 14 18:39:08 +0000 2018  itsamandaross   \n",
       "26    Sun Jan 14 18:37:06 +0000 2018  itsamandaross   \n",
       "27    Sun Jan 14 18:34:19 +0000 2018  itsamandaross   \n",
       "28    Sun Jan 14 18:31:41 +0000 2018  itsamandaross   \n",
       "29    Sun Jan 14 18:29:13 +0000 2018  itsamandaross   \n",
       "...                              ...            ...   \n",
       "1633  Tue Jan 24 02:11:32 +0000 2017  itsamandaross   \n",
       "1634  Sun Jan 22 21:20:36 +0000 2017  itsamandaross   \n",
       "1635  Sun Jan 22 18:05:34 +0000 2017  itsamandaross   \n",
       "1636  Sun Jan 22 17:11:17 +0000 2017  itsamandaross   \n",
       "1637  Sun Jan 22 14:55:31 +0000 2017  itsamandaross   \n",
       "1638  Sat Jan 21 23:15:34 +0000 2017  itsamandaross   \n",
       "1639  Sat Jan 21 22:23:58 +0000 2017  itsamandaross   \n",
       "1640  Sat Jan 21 14:20:31 +0000 2017  itsamandaross   \n",
       "1641  Sat Jan 21 11:08:58 +0000 2017  itsamandaross   \n",
       "1642  Sat Jan 21 10:35:35 +0000 2017  itsamandaross   \n",
       "1643  Sat Jan 21 10:32:46 +0000 2017  itsamandaross   \n",
       "1644  Sat Jan 21 05:13:01 +0000 2017  itsamandaross   \n",
       "1645  Sat Jan 21 05:08:36 +0000 2017  itsamandaross   \n",
       "1646  Sat Jan 21 03:41:01 +0000 2017  itsamandaross   \n",
       "1647  Sat Jan 21 03:39:01 +0000 2017  itsamandaross   \n",
       "1648  Sat Jan 21 03:15:07 +0000 2017  itsamandaross   \n",
       "1649  Sat Jan 21 00:34:29 +0000 2017  itsamandaross   \n",
       "1650  Sat Jan 21 00:15:30 +0000 2017  itsamandaross   \n",
       "1651  Fri Jan 20 22:07:05 +0000 2017  itsamandaross   \n",
       "1652  Fri Jan 20 03:35:22 +0000 2017  itsamandaross   \n",
       "1653  Fri Jan 20 02:50:17 +0000 2017  itsamandaross   \n",
       "1654  Fri Jan 20 01:50:13 +0000 2017  itsamandaross   \n",
       "1655  Fri Jan 20 01:22:17 +0000 2017  itsamandaross   \n",
       "1656  Thu Jan 19 20:25:59 +0000 2017  itsamandaross   \n",
       "1657  Thu Jan 19 15:54:49 +0000 2017  itsamandaross   \n",
       "1658  Thu Jan 19 01:52:48 +0000 2017  itsamandaross   \n",
       "1659  Wed Jan 18 20:27:02 +0000 2017  itsamandaross   \n",
       "1660  Wed Jan 18 20:01:38 +0000 2017  itsamandaross   \n",
       "1661  Wed Jan 18 14:27:00 +0000 2017  itsamandaross   \n",
       "1662  Tue Jan 17 12:42:15 +0000 2017  itsamandaross   \n",
       "\n",
       "                       mined_at  retweet_count  \\\n",
       "0    2018-01-20 01:56:49.213123              0   \n",
       "1    2018-01-20 01:56:49.213143              0   \n",
       "2    2018-01-20 01:56:49.213150              0   \n",
       "3    2018-01-20 01:56:49.213155              1   \n",
       "4    2018-01-20 01:56:49.213161              0   \n",
       "5    2018-01-20 01:56:49.213167              2   \n",
       "6    2018-01-20 01:56:49.213172              1   \n",
       "7    2018-01-20 01:56:49.213178              0   \n",
       "8    2018-01-20 01:56:49.213183              1   \n",
       "9    2018-01-20 01:56:49.213189              0   \n",
       "10   2018-01-20 01:56:49.213193              4   \n",
       "11   2018-01-20 01:56:49.213199              0   \n",
       "12   2018-01-20 01:56:49.213204              0   \n",
       "13   2018-01-20 01:56:49.213208              1   \n",
       "14   2018-01-20 01:56:49.213214              0   \n",
       "15   2018-01-20 01:56:49.213219              0   \n",
       "16   2018-01-20 01:56:49.213225              0   \n",
       "17   2018-01-20 01:56:49.213231              0   \n",
       "18   2018-01-20 01:56:49.213237              0   \n",
       "19   2018-01-20 01:56:49.213241              1   \n",
       "20   2018-01-20 01:56:49.213245              6   \n",
       "21   2018-01-20 01:56:49.213251              0   \n",
       "22   2018-01-20 01:56:49.213256              1   \n",
       "23   2018-01-20 01:56:49.213260              3   \n",
       "24   2018-01-20 01:56:49.213265              1   \n",
       "25   2018-01-20 01:56:49.213269              2   \n",
       "26   2018-01-20 01:56:49.213274              0   \n",
       "27   2018-01-20 01:56:49.213279              1   \n",
       "28   2018-01-20 01:56:49.213283              3   \n",
       "29   2018-01-20 01:56:49.213288             12   \n",
       "...                         ...            ...   \n",
       "1633 2018-01-20 01:56:55.224317              0   \n",
       "1634 2018-01-20 01:56:55.224322              0   \n",
       "1635 2018-01-20 01:56:55.224327              0   \n",
       "1636 2018-01-20 01:56:55.224332              0   \n",
       "1637 2018-01-20 01:56:55.224337              0   \n",
       "1638 2018-01-20 01:56:55.224342              0   \n",
       "1639 2018-01-20 01:56:55.224348              0   \n",
       "1640 2018-01-20 01:56:55.224353              0   \n",
       "1641 2018-01-20 01:56:55.224358              0   \n",
       "1642 2018-01-20 01:56:55.224362              0   \n",
       "1643 2018-01-20 01:56:55.224367              0   \n",
       "1644 2018-01-20 01:56:55.224371              1   \n",
       "1645 2018-01-20 01:56:55.224376              0   \n",
       "1646 2018-01-20 01:56:55.224380              3   \n",
       "1647 2018-01-20 01:56:55.224386              0   \n",
       "1648 2018-01-20 01:56:55.224390              1   \n",
       "1649 2018-01-20 01:56:55.224395              0   \n",
       "1650 2018-01-20 01:56:55.224400              0   \n",
       "1651 2018-01-20 01:56:55.224404              3   \n",
       "1652 2018-01-20 01:56:55.224410              0   \n",
       "1653 2018-01-20 01:56:55.224414              0   \n",
       "1654 2018-01-20 01:56:55.224419              2   \n",
       "1655 2018-01-20 01:56:55.224423              1   \n",
       "1656 2018-01-20 01:56:55.224427              0   \n",
       "1657 2018-01-20 01:56:55.224433              0   \n",
       "1658 2018-01-20 01:56:55.224438              0   \n",
       "1659 2018-01-20 01:56:55.224443              0   \n",
       "1660 2018-01-20 01:56:55.224448              0   \n",
       "1661 2018-01-20 01:56:55.224453              0   \n",
       "1662 2018-01-20 01:56:55.224458              0   \n",
       "\n",
       "                                                   text            tweet_id  \n",
       "0           @internest_the Kim: https://t.co/nTlswKbVuy  954111353911988224  \n",
       "1     @Its_dean @internest_the counterpoint: y'all s...  954038001914572800  \n",
       "2     why is this a promoted tweet on my TL lol http...  954008713030963200  \n",
       "3     @BomptonBrotha88 honestly yeah youre right i t...  954007425899814913  \n",
       "4     @TracieMorrissey @elenimitzali There's an EIC ...  953642258305376257  \n",
       "5     Third world men? Aziz was born in South Caroli...  953265784880541701  \n",
       "6     The rumors are NOT true! I don’t like to suck ...  953096644400214017  \n",
       "7     What if god was one of us https://t.co/IQ3BM0oKPC  953095822455005185  \n",
       "8     “You mean you can’t chase a woman around the r...  953059187654889474  \n",
       "9         @JNkappers Lemme help https://t.co/fIUTY7MrzA  952996141863526401  \n",
       "10    “Well if THAT’S sexual assault then lock me up...  952946947362607105  \n",
       "11    @annalikestweets The world wasn’t ready for a ...  952945353950662656  \n",
       "12    @juleslasaslvia @JillFilipovic  https://t.co/m...  952930025812189185  \n",
       "13                              https://t.co/iAMxAQmHYc  952734573431017472  \n",
       "14    @currency_kitten I’m good with the media-speci...  952687683767238656  \n",
       "15    @MyAlteredEgo Would be happy discus this if yo...  952644813391826944  \n",
       "16    @MyAlteredEgo We were told a story in the publ...  952644135365890048  \n",
       "17    @MyAlteredEgo Yes, it’s an accepted, common an...  952642841687273472  \n",
       "18    @_hannah_tomes Right? Like thanks for saying I...  952640284621492226  \n",
       "19    @MyAlteredEgo We repeatedly called and email s...  952639592603226112  \n",
       "20    Guy sends me a link to a forum thread in which...  952639106772815873  \n",
       "21    @HeadCaseLifeNYC Oh you mean like this? https:...  952630500333678595  \n",
       "22    This thread (last tweet!) is not to argue  abo...  952613304781983745  \n",
       "23    As the editor of @babedotnet, I’m not a judge,...  952612434958831618  \n",
       "24    We had no reason to believe so. Aziz has the c...  952611739010523136  \n",
       "25    Especially when a source wants to say anonymou...  952611054588227584  \n",
       "26    The incredible @k80way did the bulk of the wor...  952610542472048640  \n",
       "27    We had meeting after meeting in which we discu...  952609841717170176  \n",
       "28    -We reached out to several members of Aziz’s t...  952609177402335233  \n",
       "29    -Read every text she sent to her friends that ...  952608559350591489  \n",
       "...                                                 ...                 ...  \n",
       "1633         Wholesome TX memes https://t.co/fteZ7CjWxY  823714825482158080  \n",
       "1634  Why do I only hang out w janky ass people http...  823279219677466625  \n",
       "1635    @LesleyVWarren good, we need to punish them all  823230137986646019  \n",
       "1636  tag yourself, i'm a bratty emo money lover htt...  823216478757470208  \n",
       "1637       Friendly bodega guys make the world go round  823182311751634944  \n",
       "1638  @Mr_Rumpels oooooh buuurn https://t.co/wCLZM1Nf6E  822945765916086274  \n",
       "1639                             Cats like plain crisps  822932779730169856  \n",
       "1640  There is a v palpable energy to today and I ha...  822811116095045633  \n",
       "1641     Ya, it's just science  https://t.co/5EDhfkB0Vf  822762910019620864  \n",
       "1642  WHAT DO MY DREAMS MEAN, HELP ME UNIVERSE 😩 ht...  822754509357285377  \n",
       "1643  Just dreamt I got told off at work so hard I s...  822753800251461632  \n",
       "1644                Big mood ⚡️ https://t.co/1FcHpjQL9V  822673332969635840  \n",
       "1645  Ooooh well done, Austin TX ⭐ https://t.co/GTOA...  822672221822943234  \n",
       "1646  @RichardBSpencer @draknats Truly an American h...  822650180050763776  \n",
       "1647  Hey @RichardBSpencer come to Harlem so I can b...  822649675933249539  \n",
       "1648  THIS IS MELANIA TRUMP'S REAL TWITTER BANNER IM...  822643660315619334  \n",
       "1649     KNUCK IF U BUCK, BITCH https://t.co/q1XzZKh3Xs  822603234921562113  \n",
       "1650  dad come back we miss u :( https://t.co/gYsdx7...  822598457290616832  \n",
       "1651  Awesome footage of D.C. cops pepper spraying s...  822566141658824704  \n",
       "1652  The Slenderman documentary is out this Monday!...  822286369267519492  \n",
       "1653  TBT to when I left the Louvre after 45 minutes...  822275025537474560  \n",
       "1654           Honestly I would just be the cutest wife  822259908280205312  \n",
       "1655  Andy's post-makeover fashion montage in The De...  822252876412162048  \n",
       "1656  can’t wait to make my next small beauty purcha...  822178311338160129  \n",
       "1657  Had a nightmare that I was boarding a plane to...  822110068728532993  \n",
       "1658    Worst part of being sick is feeling useless tbh  821898168417878016  \n",
       "1659               Worse 😊😊😊 https://t.co/ZfbMq4mTYL  821816187369623553  \n",
       "1660  Deadly combo of cough medicine, Real Housewive...  821809794491224064  \n",
       "1661  Will this hydrocodone cough syrup make me a be...  821725582480338944  \n",
       "1662                  @szangani https://t.co/EFCeQMnpRc  821336835188228096  \n",
       "\n",
       "[1663 rows x 6 columns]"
      ]
     },
     "execution_count": 63,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "amanda_tweets = pd.DataFrame(amanda)\n",
    "amanda_tweets"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 64,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(2682, 6)"
      ]
     },
     "execution_count": 64,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tweets1 = pd.concat([una_tweets, amanda_tweets], axis=0)\n",
    "tweets1.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Check out these n-grams. T Swift right at the top for Amanda. #shocking"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 65,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[(u'jcalder93 https', 11),\n",
       " (u'chapel hill', 8),\n",
       " (u'lt lt', 8),\n",
       " (u'social media', 8),\n",
       " (u'foram_491 https', 6),\n",
       " (u'high school', 5),\n",
       " (u'look like', 5),\n",
       " (u'dom_less bubbaprog', 5),\n",
       " (u'gt gt', 4),\n",
       " (u'feel like', 4),\n",
       " (u'lt lt lt', 4),\n",
       " (u'ya know', 4),\n",
       " (u'dom_less byrontau', 4),\n",
       " (u'makes sad', 4),\n",
       " (u'itsamandaross https', 4),\n",
       " (u'https 1o7dzk5llp', 4),\n",
       " (u'yr old', 3),\n",
       " (u'like https', 3),\n",
       " (u'just want', 3),\n",
       " (u'plus sized', 3)]"
      ]
     },
     "execution_count": 65,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# We can use the TfidfVectorizer to find ngrams for us\n",
    "vect = TfidfVectorizer(ngram_range=(2,5), stop_words='english')\n",
    "\n",
    "# Pulls all of Una's tweet text's into one giant string\n",
    "summaries = \"\".join(una_tweets['text'])\n",
    "ngrams_summaries = vect.build_analyzer()(summaries)\n",
    "\n",
    "Counter(ngrams_summaries).most_common(20)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[(u'taylor swift', 21),\n",
       " (u'reputation tonight', 14),\n",
       " (u'reputation tonight reputation', 13),\n",
       " (u'tonight reputation', 13),\n",
       " (u'reputation tonight reputation tonight', 12),\n",
       " (u'tonight reputation tonight', 12),\n",
       " (u'tonight reputation tonight reputation', 12),\n",
       " (u'white people', 10),\n",
       " (u'gospursgo gospursgo', 10),\n",
       " (u'brand new', 10),\n",
       " (u'feel like', 9),\n",
       " (u'gospursgo gospursgo gospursgo', 9),\n",
       " (u'like https', 8),\n",
       " (u'oh god', 8),\n",
       " (u'gospursgo gospursgo gospursgo gospursgo', 8),\n",
       " (u'lol https', 7),\n",
       " (u'just wanna', 7),\n",
       " (u'fuck https', 6),\n",
       " (u'mood https', 6),\n",
       " (u'look like', 6)]"
      ]
     },
     "execution_count": 66,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "vect = TfidfVectorizer(ngram_range=(2,4), stop_words='english')\n",
    "\n",
    "summaries = \"\".join(amanda_tweets['text'])\n",
    "ngrams_summaries = vect.build_analyzer()(summaries)\n",
    "\n",
    "Counter(ngrams_summaries).most_common(20)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 67,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "tweet_text1 = tweets1['text'].values\n",
    "clean_text1 = [preprocess_text(x, fix_unicode=True, lowercase=True, no_urls=True, no_emails=True, no_phone_numbers=True, no_currency_symbols=True,\n",
    "                              no_punct=True, no_accents=True)\n",
    "              for x in tweet_text1]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 68,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[ u'today my dad told me he \\u201clikes that guy Gucci Mane\\u201d so I\\u2019m gonna go kill myself'\n",
      " u'how?!??? why??!?? https://t.co/mPnxfsfZjH'\n",
      " u'trendy!!!!!! https://t.co/xDq403aujt' u'-@realJoeCalder'\n",
      " u'Seen in a Bushwick bookstore: https://t.co/2zCcpaa5md'\n",
      " u'Facebook reminds me everyday to never feel THAT good about myself https://t.co/sw8m3re0nK'\n",
      " u'NEW content FUN times WOw https://t.co/hwMcE5ZTCy']\n"
     ]
    }
   ],
   "source": [
    "print tweet_text1[1:8]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[u'today my dad told me he likes that guy gucci mane so im gonna go kill myself', u'how why url', u'trendy url', u'realjoecalder', u'seen in a bushwick bookstore url', u'facebook reminds me everyday to never feel that good about myself url', u'new content fun times wow url']\n"
     ]
    }
   ],
   "source": [
    "print clean_text1[1:8]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 70,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.620059656972\n"
     ]
    }
   ],
   "source": [
    "y1 = tweets1['handle'].map(lambda x: 1 if x == 'itsamandaross' else 0).values\n",
    "print max(pd.Series(y1).value_counts(normalize=True))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 72,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(2682, 2000)\n"
     ]
    }
   ],
   "source": [
    "tfv = TfidfVectorizer(ngram_range=(1,4), max_features=2000)\n",
    "X1 = tfv.fit_transform(clean_text1).todense()\n",
    "print X1.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 73,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Fitting 10 folds for each of 200 candidates, totalling 2000 fits\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "[Parallel(n_jobs=1)]: Done 2000 out of 2000 | elapsed:  1.4min finished\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "GridSearchCV(cv=10, error_score='raise',\n",
       "       estimator=LogisticRegression(C=1.0, class_weight=None, dual=False, fit_intercept=True,\n",
       "          intercept_scaling=1, max_iter=100, multi_class='ovr', n_jobs=1,\n",
       "          penalty='l2', random_state=None, solver='liblinear', tol=0.0001,\n",
       "          verbose=0, warm_start=False),\n",
       "       fit_params=None, iid=True, n_jobs=1,\n",
       "       param_grid={'penalty': ['l1', 'l2'], 'C': array([  1.00000e-05,   1.12332e-05, ...,   8.90215e-01,   1.00000e+00])},\n",
       "       pre_dispatch='2*n_jobs', refit=True, return_train_score='warn',\n",
       "       scoring=None, verbose=1)"
      ]
     },
     "execution_count": 73,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "lr1 = LogisticRegression()\n",
    "params1 = {'penalty': ['l1', 'l2'], 'C':np.logspace(-5,0,100)}\n",
    "#Grid searching to find optimal parameters for Logistic Regression\n",
    "gs_1 = GridSearchCV(lr1, param_grid=params1, cv=10, verbose=1)\n",
    "gs_1.fit(X1, y1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 74,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'penalty': 'l2', 'C': 1.0}\n",
      "0.752796420582\n"
     ]
    }
   ],
   "source": [
    "print gs_1.best_params_\n",
    "print gs_1.best_score_"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Still a pretty decent score.**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 113,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.752840128749\n",
      "0.491280221958\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "[Parallel(n_jobs=1)]: Done  10 out of  10 | elapsed:    0.6s finished\n"
     ]
    }
   ],
   "source": [
    "from sklearn.neighbors import KNeighborsClassifier\n",
    "from sklearn.tree import DecisionTreeClassifier\n",
    "from sklearn.svm import SVC\n",
    "\n",
    "accuracies = cross_val_score(LogisticRegression(), X1, y1, cv=10, verbose=1)\n",
    "\n",
    "print accuracies.mean()\n",
    "print y.mean()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 114,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Proba_Una</th>\n",
       "      <th>Proba_Amanda</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0.594196</td>\n",
       "      <td>0.405804</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0.354655</td>\n",
       "      <td>0.645345</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Proba_Una  Proba_Amanda\n",
       "0   0.594196      0.405804\n",
       "1   0.354655      0.645345"
      ]
     },
     "execution_count": 114,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "estimator = LogisticRegression()\n",
    "estimator.fit(X1,y1)\n",
    "\n",
    "source_test = [\n",
    "    \"My new skincare routine makes me wanna run a marathon, save the elephants, and drink 8 gallons of water all at the same time\",\n",
    "    \"I just wanna know what the fuck happened last night between the hours of 5 pm and 5 am\"\n",
    "]\n",
    "\n",
    "Xtest = tfv.transform(source_test)\n",
    "pd.DataFrame(estimator.predict_proba(Xtest), columns=[\"Proba_Una\", \"Proba_Amanda\"])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 115,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 0.23455396,  0.76544604],\n",
       "       [ 0.30520921,  0.69479079],\n",
       "       [ 0.48281644,  0.51718356],\n",
       "       ..., \n",
       "       [ 0.17327266,  0.82672734],\n",
       "       [ 0.40098317,  0.59901683],\n",
       "       [ 0.23242993,  0.76757007]])"
      ]
     },
     "execution_count": 115,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# A:\n",
    "estimator.predict_proba(X1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 116,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "Probas = pd.DataFrame(estimator.predict_proba(X1), columns=[\"Proba_Una\", \"Proba_Amanda\"])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 117,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "joined = pd.merge(tweets1, Probas, left_index=True, right_index=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 118,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>created_at</th>\n",
       "      <th>handle</th>\n",
       "      <th>mined_at</th>\n",
       "      <th>retweet_count</th>\n",
       "      <th>text</th>\n",
       "      <th>tweet_id</th>\n",
       "      <th>Proba_Una</th>\n",
       "      <th>Proba_Amanda</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Sat Jan 20 02:17:07 +0000 2018</td>\n",
       "      <td>una_dab</td>\n",
       "      <td>2018-01-20 01:56:42.231974</td>\n",
       "      <td>0</td>\n",
       "      <td>Also him: “I like ‘Motorsport’”</td>\n",
       "      <td>954538246897389568</td>\n",
       "      <td>0.234554</td>\n",
       "      <td>0.765446</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Thu Jan 18 22:00:47 +0000 2018</td>\n",
       "      <td>itsamandaross</td>\n",
       "      <td>2018-01-20 01:56:49.213123</td>\n",
       "      <td>0</td>\n",
       "      <td>@internest_the Kim: https://t.co/nTlswKbVuy</td>\n",
       "      <td>954111353911988224</td>\n",
       "      <td>0.234554</td>\n",
       "      <td>0.765446</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                       created_at         handle                   mined_at  \\\n",
       "0  Sat Jan 20 02:17:07 +0000 2018        una_dab 2018-01-20 01:56:42.231974   \n",
       "0  Thu Jan 18 22:00:47 +0000 2018  itsamandaross 2018-01-20 01:56:49.213123   \n",
       "\n",
       "   retweet_count                                         text  \\\n",
       "0              0              Also him: “I like ‘Motorsport’”   \n",
       "0              0  @internest_the Kim: https://t.co/nTlswKbVuy   \n",
       "\n",
       "             tweet_id  Proba_Una  Proba_Amanda  \n",
       "0  954538246897389568   0.234554      0.765446  \n",
       "0  954111353911988224   0.234554      0.765446  "
      ]
     },
     "execution_count": 118,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "joined.head(2)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 119,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "@foram_491 Facts\n",
      "@foram_491 💁🏼💁🏼💁🏼\n",
      "@foram_491 phew\n",
      "@foram_491 😢😇\n"
     ]
    }
   ],
   "source": [
    "joined_una = joined[joined['handle']==\"una_dab\"]\n",
    "for el in joined_una[joined_una['Proba_Una']==max(joined_una['Proba_Una'])]['text']:\n",
    "    print el"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 120,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "my element https://t.co/pgK6npXrrU\n"
     ]
    }
   ],
   "source": [
    "for el in joined_una[joined_una['Proba_Una']==min(joined_una['Proba_Una'])]['text']:\n",
    "    print el"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 121,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Friendly bodega guys make the world go round\n"
     ]
    }
   ],
   "source": [
    "joined_amanda = joined[joined['handle']==\"itsamandaross\"]\n",
    "for el in joined_amanda[joined_amanda['Proba_Amanda']==max(joined_amanda['Proba_Amanda'])]['text']:\n",
    "    print el"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 122,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "I’ll know I actually like a guy when I wash my hair before a date\n",
      "I'm so tired of art hoes https://t.co/cZMptQVCNI\n",
      "I think what I really want is to marry like a hot earth scientist\n",
      "U ever take a shower so hot it strips you of all ur sins plus ur top layer of skin\n"
     ]
    }
   ],
   "source": [
    "for el in joined_amanda[joined_amanda['Proba_Amanda']==min(joined_amanda['Proba_Amanda'])]['text']:\n",
    "    print el"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Now it's Matt and Josh's Turn"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 123,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "x2 = api.GetUserTimeline(screen_name=\"JNkappers\", count=20, include_rts=False)\n",
    "x2 = [_.AsDict() for _ in x2]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 124,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{u'created_at': u'Thu Jan 18 15:10:07 +0000 2018',\n",
       " u'favorite_count': 1,\n",
       " u'full_text': u'The royals, just like us \\nhttps://t.co/dttTM8pcBs',\n",
       " u'hashtags': [],\n",
       " u'id': 954008004927610880,\n",
       " u'id_str': u'954008004927610880',\n",
       " u'lang': u'en',\n",
       " u'source': u'<a href=\"http://twitter.com\" rel=\"nofollow\">Twitter Web Client</a>',\n",
       " u'urls': [{u'expanded_url': u'https://thetab.com/uk/2018/01/18/prince-william-is-the-latest-posh-boy-to-shave-his-head-58471',\n",
       "   u'url': u'https://t.co/dttTM8pcBs'}],\n",
       " u'user': {u'created_at': u'Mon Mar 09 21:19:31 +0000 2009',\n",
       "  u'description': u'Audience Development Editor @tabmediainc Occasional radio personality. Heir to the @kaplan_univ throne. Willing servant of the Zionist media conspiracy',\n",
       "  u'favourites_count': 5459,\n",
       "  u'followers_count': 1207,\n",
       "  u'following': True,\n",
       "  u'friends_count': 1075,\n",
       "  u'geo_enabled': True,\n",
       "  u'id': 23503335,\n",
       "  u'lang': u'en',\n",
       "  u'listed_count': 6,\n",
       "  u'location': u'United States',\n",
       "  u'name': u'Josh Kaplan',\n",
       "  u'profile_background_color': u'709397',\n",
       "  u'profile_background_image_url': u'http://pbs.twimg.com/profile_background_images/793696735/1a5da7e0638158418c0e05dca8318bdb.jpeg',\n",
       "  u'profile_banner_url': u'https://pbs.twimg.com/profile_banners/23503335/1479851196',\n",
       "  u'profile_image_url': u'http://pbs.twimg.com/profile_images/882681515691450369/zDUacpF3_normal.jpg',\n",
       "  u'profile_link_color': u'FF3300',\n",
       "  u'profile_sidebar_fill_color': u'A0C5C7',\n",
       "  u'profile_text_color': u'333333',\n",
       "  u'screen_name': u'JNkappers',\n",
       "  u'statuses_count': 4413,\n",
       "  u'time_zone': u'London',\n",
       "  u'url': u'https://t.co/IRgBnrAFGO'},\n",
       " u'user_mentions': []}"
      ]
     },
     "execution_count": 124,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "x2[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 125,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "y2 = api.GetUserTimeline(screen_name=\"mattjpfmcdonald\", count=20, max_id=935706980643147777, include_rts=False)\n",
    "y2 = [_.AsDict() for _ in y2]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 126,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{u'created_at': u'Wed Nov 29 02:46:29 +0000 2017',\n",
       " u'favorite_count': 6,\n",
       " u'full_text': u'go follow your local @TheTab school on instagram',\n",
       " u'hashtags': [],\n",
       " u'id': 935701470560882689,\n",
       " u'id_str': u'935701470560882689',\n",
       " u'lang': u'en',\n",
       " u'retweet_count': 3,\n",
       " u'source': u'<a href=\"http://twitter.com\" rel=\"nofollow\">Twitter Web Client</a>',\n",
       " u'urls': [],\n",
       " u'user': {u'created_at': u'Thu Feb 05 20:52:02 +0000 2009',\n",
       "  u'description': u'us editor @thetab. previously subeditor @thesundaytimes/@st_sport. tips@thetab.com if you have a story, matt@thetab.com for all abuse. https://t.co/26kkQpFPUi',\n",
       "  u'favourites_count': 4570,\n",
       "  u'followers_count': 1104,\n",
       "  u'following': True,\n",
       "  u'friends_count': 982,\n",
       "  u'geo_enabled': True,\n",
       "  u'id': 20186557,\n",
       "  u'lang': u'en',\n",
       "  u'listed_count': 17,\n",
       "  u'location': u'New York',\n",
       "  u'name': u'Matt McDonald',\n",
       "  u'profile_background_color': u'000000',\n",
       "  u'profile_background_image_url': u'http://abs.twimg.com/images/themes/theme1/bg.png',\n",
       "  u'profile_banner_url': u'https://pbs.twimg.com/profile_banners/20186557/1497394847',\n",
       "  u'profile_image_url': u'http://pbs.twimg.com/profile_images/875008940748267520/rRBq5lm6_normal.jpg',\n",
       "  u'profile_link_color': u'EE282E',\n",
       "  u'profile_sidebar_fill_color': u'000000',\n",
       "  u'profile_text_color': u'000000',\n",
       "  u'screen_name': u'mattjpfmcdonald',\n",
       "  u'statuses_count': 4401,\n",
       "  u'time_zone': u'Eastern Time (US & Canada)',\n",
       "  u'url': u'https://t.co/VrqButOTlq',\n",
       "  u'utc_offset': -18000},\n",
       " u'user_mentions': [{u'id': 759319046,\n",
       "   u'name': u'The Tab',\n",
       "   u'screen_name': u'TheTab'}]}"
      ]
     },
     "execution_count": 126,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "y2[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 127,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "954008004927610880\n",
      "The royals, just like us \n",
      "https://t.co/dttTM8pcBs\n",
      "--\n",
      "953583065112117248\n",
      "If people don't start their tweets with \"some personal news\" how am I supposed to know who to mute????\n",
      "--\n",
      "953223642741202945\n",
      "Day 3 of excessive Juul usage, 3 pods deeps and I can't remember what it feels like to not taste mangoes with every breath\n",
      "--\n"
     ]
    }
   ],
   "source": [
    "for element in x2:\n",
    "    print element['id']\n",
    "    print(element['full_text'])\n",
    "    print('--')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 128,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "935701470560882689\n",
      "go follow your local @TheTab school on instagram\n",
      "--\n",
      "935560026307129347\n",
      "no lol https://t.co/Xu3o3IAE44\n",
      "--\n",
      "935186490929401857\n",
      "@ariellewastaken @idsnews why aren't they writing for @TheTab\n",
      "--\n",
      "934973732896026625\n",
      "on my way back after a long, hard weekend of owning the libs\n",
      "--\n",
      "934834620184645632\n",
      "and every time professor trelawney tells someone they are in ‘grave danger’, in the grand scheme of things she is probably right\n",
      "--\n",
      "934831328574541828\n",
      "also that look ginny gives him when she’s leaving the room of requirement and he’s about to take the tongue express to chang town\n",
      "--\n",
      "934829661506465794\n",
      "@edcmpbl what if umbridge found out the list existed and used the accio charm, they’d be fucked\n",
      "--\n",
      "934828758003044352\n",
      "watching harry potter 5, the first thing their illegal magic group do is put their names on a list together, seems pretty counterintuitive\n",
      "--\n",
      "934637009167110144\n",
      "@ABC @itsamandaross when did u have a kid\n",
      "--\n",
      "934613481441112066\n",
      "you don’t choose your family, but there’s no-one else i’d pick https://t.co/fwnA8GQxPd\n",
      "--\n",
      "934481662242643969\n",
      "like this if you’re aware that england are in a world cup final\n",
      "--\n",
      "934159464298663936\n",
      "piers the website you write for said a lorry crashed into pedestrians. how can you hold olly murs to a higher standard than a news site? https://t.co/V8hHn1pYqL\n",
      "--\n",
      "934119601910280195\n",
      "malia obama in ‘coolest kid at harvard’ shocker https://t.co/S6Z2xZlXBc\n",
      "--\n",
      "934066496308989953\n",
      "‘hi! i am emailing to ask if you are accepting guest posts at this t-‘ https://t.co/2QQldLaeU0\n",
      "--\n",
      "933517695919775746\n",
      "@JNkappers R-fucking-T jo\n",
      "--\n",
      "933343950370426880\n",
      "@JNkappers @carolinephinney @carrie_radigan was looking for an excuse to never speak to you again, thank you for providing one\n",
      "--\n"
     ]
    }
   ],
   "source": [
    "for element in y2:\n",
    "    print element['id']\n",
    "    print(element['full_text'])\n",
    "    print('--')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 129,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "Josh = miner.mine_user_tweets(user=\"JNkappers\")\n",
    "Matt = miner.mine_user_tweets(user=\"mattjpfmcdonald\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 130,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The royals, just like us \n",
      "https://t.co/dttTM8pcBs\n",
      "---\n",
      "If people don't start their tweets with \"some personal news\" how am I supposed to know who to mute????\n",
      "---\n",
      "Day 3 of excessive Juul usage, 3 pods deeps and I can't remember what it feels like to not taste mangoes with every breath\n",
      "---\n",
      "Siri, show treatment options for Juul addiction\n",
      "---\n",
      "Looooool https://t.co/v2qEKd5uDR\n",
      "---\n"
     ]
    }
   ],
   "source": [
    "for x2 in range(5):\n",
    "    print Josh[x2]['text']\n",
    "    print('---')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 131,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "#ff my sister @sarahfmcdonald for all your godly needs, because it's her birthday and she OLD\n",
      "--\n",
      "@mikemancini my god\n",
      "--\n",
      "@TheTab also just seven-balled @mattgibson27 and @robertwhite2123 in pool https://t.co/pWim1s1b7u\n",
      "--\n",
      "@Ned_Donovan @TheTab the tab dot com is kinda like babedotnet but for uni\n",
      "--\n",
      "hate to brag but @TheTab’s american college accounts just cruised past 30,000 followers. so yeah, that’s how my week’s goin’\n",
      "--\n"
     ]
    }
   ],
   "source": [
    "for x in range(5):\n",
    "    print Matt[x]['text']\n",
    "    print('--')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 132,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>created_at</th>\n",
       "      <th>handle</th>\n",
       "      <th>mined_at</th>\n",
       "      <th>retweet_count</th>\n",
       "      <th>text</th>\n",
       "      <th>tweet_id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Thu Jan 18 15:10:07 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315685</td>\n",
       "      <td>0</td>\n",
       "      <td>The royals, just like us \\nhttps://t.co/dttTM8...</td>\n",
       "      <td>954008004927610880</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Wed Jan 17 11:01:34 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315702</td>\n",
       "      <td>0</td>\n",
       "      <td>If people don't start their tweets with \"some ...</td>\n",
       "      <td>953583065112117248</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Tue Jan 16 11:13:21 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315708</td>\n",
       "      <td>0</td>\n",
       "      <td>Day 3 of excessive Juul usage, 3 pods deeps an...</td>\n",
       "      <td>953223642741202945</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Mon Jan 15 20:05:05 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315714</td>\n",
       "      <td>0</td>\n",
       "      <td>Siri, show treatment options for Juul addiction</td>\n",
       "      <td>952995071225417729</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Mon Jan 15 14:50:04 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315720</td>\n",
       "      <td>0</td>\n",
       "      <td>Looooool https://t.co/v2qEKd5uDR</td>\n",
       "      <td>952915795146928128</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Sun Jan 14 11:01:03 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315726</td>\n",
       "      <td>0</td>\n",
       "      <td>@ko14vonn @TabMediaInc Yeah ofc, dm me whenever</td>\n",
       "      <td>952495771642974208</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Sun Jan 14 10:52:45 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315732</td>\n",
       "      <td>0</td>\n",
       "      <td>@ko14vonn @TabMediaInc I’ve worked for tab med...</td>\n",
       "      <td>952493682468511744</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Sun Jan 14 10:29:10 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315737</td>\n",
       "      <td>0</td>\n",
       "      <td>@ko14vonn Feel free to check out @TabMediaInc ...</td>\n",
       "      <td>952487748123942912</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Sun Jan 14 10:23:22 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315742</td>\n",
       "      <td>0</td>\n",
       "      <td>@leroy87dacosta @MasterofNone @azizansari http...</td>\n",
       "      <td>952486290842357760</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Wed Jan 10 21:27:14 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315748</td>\n",
       "      <td>0</td>\n",
       "      <td>The 11th Commandment of the LAD Bible: \"Thou s...</td>\n",
       "      <td>951203804757753856</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>Wed Jan 10 21:06:07 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315753</td>\n",
       "      <td>1</td>\n",
       "      <td>New year, new @HShukman https://t.co/eTHV3zwvJG</td>\n",
       "      <td>951198490004213763</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Wed Jan 10 19:44:06 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315757</td>\n",
       "      <td>1</td>\n",
       "      <td>How has someone interviewed Floyd Mayweather, ...</td>\n",
       "      <td>951177849582612480</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Wed Jan 10 15:35:30 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315763</td>\n",
       "      <td>0</td>\n",
       "      <td>Get it together lads, the family name is at st...</td>\n",
       "      <td>951115290405982208</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Tue Jan 09 13:27:00 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315768</td>\n",
       "      <td>0</td>\n",
       "      <td>How has it got to the stage where I see 30 on ...</td>\n",
       "      <td>950720564502630403</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Tue Jan 09 03:47:05 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315774</td>\n",
       "      <td>0</td>\n",
       "      <td>Just when you think @Quora isnt just white peo...</td>\n",
       "      <td>950574620893212672</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Mon Jan 08 22:38:19 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315779</td>\n",
       "      <td>0</td>\n",
       "      <td>Fin.</td>\n",
       "      <td>950496919238905857</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Mon Jan 08 22:38:12 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315785</td>\n",
       "      <td>0</td>\n",
       "      <td>“My mom’s calling ... how embarrassing,”</td>\n",
       "      <td>950496887655759872</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Mon Jan 08 22:37:02 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315791</td>\n",
       "      <td>0</td>\n",
       "      <td>“Bro, my dad now arranged for you a $20bn deal...</td>\n",
       "      <td>950496596885680128</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>Mon Jan 08 22:36:52 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315797</td>\n",
       "      <td>0</td>\n",
       "      <td>\"My dad made an awesome deal for your dad, bro...</td>\n",
       "      <td>950496552220577792</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>Mon Jan 08 22:36:36 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315802</td>\n",
       "      <td>0</td>\n",
       "      <td>“Bro, you got to spot me\"</td>\n",
       "      <td>950496485413740545</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Mon Jan 08 22:36:04 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315808</td>\n",
       "      <td>0</td>\n",
       "      <td>The best quotes from Yair Netanyahu's outrageo...</td>\n",
       "      <td>950496354144530432</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>Mon Jan 08 22:31:47 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315814</td>\n",
       "      <td>0</td>\n",
       "      <td>@DixPeyton *fewer</td>\n",
       "      <td>950495273524060162</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>Mon Jan 08 02:38:43 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315819</td>\n",
       "      <td>0</td>\n",
       "      <td>Congrats on ur win James Franco, here are some...</td>\n",
       "      <td>950195028651053056</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>Sat Jan 06 22:10:03 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315824</td>\n",
       "      <td>0</td>\n",
       "      <td>I just wish Facebook had an option to hide any...</td>\n",
       "      <td>949765030043705346</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>Fri Jan 05 21:48:27 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315829</td>\n",
       "      <td>2</td>\n",
       "      <td>You vs. the guy she tells you not to worry abo...</td>\n",
       "      <td>949397204078333953</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>Fri Jan 05 21:44:37 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315834</td>\n",
       "      <td>0</td>\n",
       "      <td>I just.. I don't even know any more https://t....</td>\n",
       "      <td>949396242832019456</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>Fri Jan 05 14:57:07 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315840</td>\n",
       "      <td>0</td>\n",
       "      <td>And that man's name? Albert Einstein. https://...</td>\n",
       "      <td>949293688638902272</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>Thu Jan 04 22:28:14 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315845</td>\n",
       "      <td>0</td>\n",
       "      <td>I achieved something today! https://t.co/Rrs1v...</td>\n",
       "      <td>949044829912227840</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>Thu Jan 04 16:11:48 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315851</td>\n",
       "      <td>0</td>\n",
       "      <td>@GregBarradale you did it mate, you found the ...</td>\n",
       "      <td>948950098486185984</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>Thu Jan 04 12:50:35 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315856</td>\n",
       "      <td>0</td>\n",
       "      <td>@thebobpalmer Why were you at uni for 17 years?</td>\n",
       "      <td>948899459676758019</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1666</th>\n",
       "      <td>Thu Sep 18 21:54:43 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.123923</td>\n",
       "      <td>0</td>\n",
       "      <td>andrew marr, cutting as usual #coldstoreinslough</td>\n",
       "      <td>512721406774087681</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1667</th>\n",
       "      <td>Thu Sep 18 21:45:16 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.123929</td>\n",
       "      <td>0</td>\n",
       "      <td>Where's dimbledawg? I want my license fee back</td>\n",
       "      <td>512719025516716032</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1668</th>\n",
       "      <td>Thu Sep 18 21:02:35 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.123934</td>\n",
       "      <td>1</td>\n",
       "      <td>Who are the people that watch election coverag...</td>\n",
       "      <td>512708283207925761</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1669</th>\n",
       "      <td>Tue Sep 16 22:35:39 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.123961</td>\n",
       "      <td>0</td>\n",
       "      <td>Misty sunrise over the Berkshires from the rec...</td>\n",
       "      <td>512006928357019649</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1670</th>\n",
       "      <td>Mon Sep 15 13:34:14 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.123973</td>\n",
       "      <td>0</td>\n",
       "      <td>@ross_sian was in front of a packed restaurant...</td>\n",
       "      <td>511508289696571392</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1671</th>\n",
       "      <td>Mon Sep 15 12:37:45 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124016</td>\n",
       "      <td>0</td>\n",
       "      <td>Walked face first into a glass door, broke my ...</td>\n",
       "      <td>511494076215361536</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1672</th>\n",
       "      <td>Sun Sep 14 17:13:43 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124026</td>\n",
       "      <td>0</td>\n",
       "      <td>\"Our day at hatch\"- an abstract art piece from...</td>\n",
       "      <td>511201139128143872</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1673</th>\n",
       "      <td>Sat Sep 13 12:23:44 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124032</td>\n",
       "      <td>0</td>\n",
       "      <td>@UoNSU I'm in the mood for something flame gri...</td>\n",
       "      <td>510765773238046720</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1674</th>\n",
       "      <td>Mon Sep 08 13:35:37 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124038</td>\n",
       "      <td>0</td>\n",
       "      <td>Genuinely forgot that Plain Lazy clothes exist...</td>\n",
       "      <td>508971924094189568</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1675</th>\n",
       "      <td>Mon Sep 08 12:57:24 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124043</td>\n",
       "      <td>0</td>\n",
       "      <td>Back home with ma bitch #demsurreyhillsdoe htt...</td>\n",
       "      <td>508962306798002177</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1676</th>\n",
       "      <td>Sat Sep 06 14:02:41 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124049</td>\n",
       "      <td>0</td>\n",
       "      <td>BBC complaints reveal the big issues from whil...</td>\n",
       "      <td>508253958146899968</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1677</th>\n",
       "      <td>Sun Aug 31 03:32:27 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124054</td>\n",
       "      <td>0</td>\n",
       "      <td>The view looking West from Citifield @ Citifie...</td>\n",
       "      <td>505921030318084096</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1678</th>\n",
       "      <td>Thu Jul 31 13:09:37 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124060</td>\n",
       "      <td>0</td>\n",
       "      <td>Red Sox Blue Jays at Fenway @ Fenway Park http...</td>\n",
       "      <td>494832252488912896</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1679</th>\n",
       "      <td>Wed Jul 30 22:15:26 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124066</td>\n",
       "      <td>0</td>\n",
       "      <td>Boston from the Charles river #ducktour @ Char...</td>\n",
       "      <td>494607223616987136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1680</th>\n",
       "      <td>Tue Jun 24 15:58:43 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124071</td>\n",
       "      <td>0</td>\n",
       "      <td>@Zac_GB ur moist m8</td>\n",
       "      <td>481466458568785921</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1681</th>\n",
       "      <td>Tue Jun 17 20:15:10 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124077</td>\n",
       "      <td>0</td>\n",
       "      <td>Watching #BRAvsMEX in an irish pub off times s...</td>\n",
       "      <td>478994282565476352</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1682</th>\n",
       "      <td>Thu Jun 12 06:50:18 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124082</td>\n",
       "      <td>0</td>\n",
       "      <td>The fall of Eric Cantor is awful news for poli...</td>\n",
       "      <td>476979790625640448</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1683</th>\n",
       "      <td>Thu Jun 12 06:29:54 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124087</td>\n",
       "      <td>0</td>\n",
       "      <td>Who are the people that need to buy duty free ...</td>\n",
       "      <td>476974658403966976</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1684</th>\n",
       "      <td>Tue Jun 10 18:38:33 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124092</td>\n",
       "      <td>0</td>\n",
       "      <td>@NraWayne is the single most deluded man in we...</td>\n",
       "      <td>476433252778246144</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1685</th>\n",
       "      <td>Tue Jun 10 18:21:08 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.124097</td>\n",
       "      <td>0</td>\n",
       "      <td>You stay classy Cardiff http://t.co/HLVnB645Kl</td>\n",
       "      <td>476428866689724416</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1686</th>\n",
       "      <td>Tue Jun 10 01:56:53 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.395575</td>\n",
       "      <td>0</td>\n",
       "      <td>Who said London cabs were expensive? http://t....</td>\n",
       "      <td>476181172201209857</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1687</th>\n",
       "      <td>Tue Jun 10 01:56:31 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.395589</td>\n",
       "      <td>0</td>\n",
       "      <td>9 hours later, mans back in guildford via flee...</td>\n",
       "      <td>476181079360282624</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1688</th>\n",
       "      <td>Mon Jun 09 23:56:59 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.395595</td>\n",
       "      <td>0</td>\n",
       "      <td>Only took 7 hours, how time flies when you're ...</td>\n",
       "      <td>476150998042701824</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1689</th>\n",
       "      <td>Mon Jun 09 22:46:42 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.395599</td>\n",
       "      <td>0</td>\n",
       "      <td>@eastcoastuk are you able to say what they can...</td>\n",
       "      <td>476133312210415616</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1690</th>\n",
       "      <td>Mon Jun 09 22:27:41 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.395604</td>\n",
       "      <td>0</td>\n",
       "      <td>@eastcoastuk 18.45 Leeds to KingsX, I understa...</td>\n",
       "      <td>476128524953456640</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1691</th>\n",
       "      <td>Mon Jun 09 21:35:44 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.395609</td>\n",
       "      <td>0</td>\n",
       "      <td>Missed my connections and dangerously close to...</td>\n",
       "      <td>476115452452941824</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1692</th>\n",
       "      <td>Fri Jun 06 16:20:50 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.395614</td>\n",
       "      <td>0</td>\n",
       "      <td>Was quite looking forward to getting a job bef...</td>\n",
       "      <td>474949041675964416</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1693</th>\n",
       "      <td>Fri Jun 06 07:38:07 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.395619</td>\n",
       "      <td>0</td>\n",
       "      <td>Dissappointed to see that @netflix have kept t...</td>\n",
       "      <td>474817498001731584</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1694</th>\n",
       "      <td>Thu Jun 05 23:56:07 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.395624</td>\n",
       "      <td>0</td>\n",
       "      <td>@JakeReesMogg always brightens election covera...</td>\n",
       "      <td>474701231341207552</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1695</th>\n",
       "      <td>Thu Jun 05 20:42:05 +0000 2014</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:29.395627</td>\n",
       "      <td>1</td>\n",
       "      <td>Two pints and change from a tenner, definitely...</td>\n",
       "      <td>474652400935268353</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>1696 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                          created_at     handle                   mined_at  \\\n",
       "0     Thu Jan 18 15:10:07 +0000 2018  JNkappers 2018-01-20 02:45:22.315685   \n",
       "1     Wed Jan 17 11:01:34 +0000 2018  JNkappers 2018-01-20 02:45:22.315702   \n",
       "2     Tue Jan 16 11:13:21 +0000 2018  JNkappers 2018-01-20 02:45:22.315708   \n",
       "3     Mon Jan 15 20:05:05 +0000 2018  JNkappers 2018-01-20 02:45:22.315714   \n",
       "4     Mon Jan 15 14:50:04 +0000 2018  JNkappers 2018-01-20 02:45:22.315720   \n",
       "5     Sun Jan 14 11:01:03 +0000 2018  JNkappers 2018-01-20 02:45:22.315726   \n",
       "6     Sun Jan 14 10:52:45 +0000 2018  JNkappers 2018-01-20 02:45:22.315732   \n",
       "7     Sun Jan 14 10:29:10 +0000 2018  JNkappers 2018-01-20 02:45:22.315737   \n",
       "8     Sun Jan 14 10:23:22 +0000 2018  JNkappers 2018-01-20 02:45:22.315742   \n",
       "9     Wed Jan 10 21:27:14 +0000 2018  JNkappers 2018-01-20 02:45:22.315748   \n",
       "10    Wed Jan 10 21:06:07 +0000 2018  JNkappers 2018-01-20 02:45:22.315753   \n",
       "11    Wed Jan 10 19:44:06 +0000 2018  JNkappers 2018-01-20 02:45:22.315757   \n",
       "12    Wed Jan 10 15:35:30 +0000 2018  JNkappers 2018-01-20 02:45:22.315763   \n",
       "13    Tue Jan 09 13:27:00 +0000 2018  JNkappers 2018-01-20 02:45:22.315768   \n",
       "14    Tue Jan 09 03:47:05 +0000 2018  JNkappers 2018-01-20 02:45:22.315774   \n",
       "15    Mon Jan 08 22:38:19 +0000 2018  JNkappers 2018-01-20 02:45:22.315779   \n",
       "16    Mon Jan 08 22:38:12 +0000 2018  JNkappers 2018-01-20 02:45:22.315785   \n",
       "17    Mon Jan 08 22:37:02 +0000 2018  JNkappers 2018-01-20 02:45:22.315791   \n",
       "18    Mon Jan 08 22:36:52 +0000 2018  JNkappers 2018-01-20 02:45:22.315797   \n",
       "19    Mon Jan 08 22:36:36 +0000 2018  JNkappers 2018-01-20 02:45:22.315802   \n",
       "20    Mon Jan 08 22:36:04 +0000 2018  JNkappers 2018-01-20 02:45:22.315808   \n",
       "21    Mon Jan 08 22:31:47 +0000 2018  JNkappers 2018-01-20 02:45:22.315814   \n",
       "22    Mon Jan 08 02:38:43 +0000 2018  JNkappers 2018-01-20 02:45:22.315819   \n",
       "23    Sat Jan 06 22:10:03 +0000 2018  JNkappers 2018-01-20 02:45:22.315824   \n",
       "24    Fri Jan 05 21:48:27 +0000 2018  JNkappers 2018-01-20 02:45:22.315829   \n",
       "25    Fri Jan 05 21:44:37 +0000 2018  JNkappers 2018-01-20 02:45:22.315834   \n",
       "26    Fri Jan 05 14:57:07 +0000 2018  JNkappers 2018-01-20 02:45:22.315840   \n",
       "27    Thu Jan 04 22:28:14 +0000 2018  JNkappers 2018-01-20 02:45:22.315845   \n",
       "28    Thu Jan 04 16:11:48 +0000 2018  JNkappers 2018-01-20 02:45:22.315851   \n",
       "29    Thu Jan 04 12:50:35 +0000 2018  JNkappers 2018-01-20 02:45:22.315856   \n",
       "...                              ...        ...                        ...   \n",
       "1666  Thu Sep 18 21:54:43 +0000 2014  JNkappers 2018-01-20 02:45:29.123923   \n",
       "1667  Thu Sep 18 21:45:16 +0000 2014  JNkappers 2018-01-20 02:45:29.123929   \n",
       "1668  Thu Sep 18 21:02:35 +0000 2014  JNkappers 2018-01-20 02:45:29.123934   \n",
       "1669  Tue Sep 16 22:35:39 +0000 2014  JNkappers 2018-01-20 02:45:29.123961   \n",
       "1670  Mon Sep 15 13:34:14 +0000 2014  JNkappers 2018-01-20 02:45:29.123973   \n",
       "1671  Mon Sep 15 12:37:45 +0000 2014  JNkappers 2018-01-20 02:45:29.124016   \n",
       "1672  Sun Sep 14 17:13:43 +0000 2014  JNkappers 2018-01-20 02:45:29.124026   \n",
       "1673  Sat Sep 13 12:23:44 +0000 2014  JNkappers 2018-01-20 02:45:29.124032   \n",
       "1674  Mon Sep 08 13:35:37 +0000 2014  JNkappers 2018-01-20 02:45:29.124038   \n",
       "1675  Mon Sep 08 12:57:24 +0000 2014  JNkappers 2018-01-20 02:45:29.124043   \n",
       "1676  Sat Sep 06 14:02:41 +0000 2014  JNkappers 2018-01-20 02:45:29.124049   \n",
       "1677  Sun Aug 31 03:32:27 +0000 2014  JNkappers 2018-01-20 02:45:29.124054   \n",
       "1678  Thu Jul 31 13:09:37 +0000 2014  JNkappers 2018-01-20 02:45:29.124060   \n",
       "1679  Wed Jul 30 22:15:26 +0000 2014  JNkappers 2018-01-20 02:45:29.124066   \n",
       "1680  Tue Jun 24 15:58:43 +0000 2014  JNkappers 2018-01-20 02:45:29.124071   \n",
       "1681  Tue Jun 17 20:15:10 +0000 2014  JNkappers 2018-01-20 02:45:29.124077   \n",
       "1682  Thu Jun 12 06:50:18 +0000 2014  JNkappers 2018-01-20 02:45:29.124082   \n",
       "1683  Thu Jun 12 06:29:54 +0000 2014  JNkappers 2018-01-20 02:45:29.124087   \n",
       "1684  Tue Jun 10 18:38:33 +0000 2014  JNkappers 2018-01-20 02:45:29.124092   \n",
       "1685  Tue Jun 10 18:21:08 +0000 2014  JNkappers 2018-01-20 02:45:29.124097   \n",
       "1686  Tue Jun 10 01:56:53 +0000 2014  JNkappers 2018-01-20 02:45:29.395575   \n",
       "1687  Tue Jun 10 01:56:31 +0000 2014  JNkappers 2018-01-20 02:45:29.395589   \n",
       "1688  Mon Jun 09 23:56:59 +0000 2014  JNkappers 2018-01-20 02:45:29.395595   \n",
       "1689  Mon Jun 09 22:46:42 +0000 2014  JNkappers 2018-01-20 02:45:29.395599   \n",
       "1690  Mon Jun 09 22:27:41 +0000 2014  JNkappers 2018-01-20 02:45:29.395604   \n",
       "1691  Mon Jun 09 21:35:44 +0000 2014  JNkappers 2018-01-20 02:45:29.395609   \n",
       "1692  Fri Jun 06 16:20:50 +0000 2014  JNkappers 2018-01-20 02:45:29.395614   \n",
       "1693  Fri Jun 06 07:38:07 +0000 2014  JNkappers 2018-01-20 02:45:29.395619   \n",
       "1694  Thu Jun 05 23:56:07 +0000 2014  JNkappers 2018-01-20 02:45:29.395624   \n",
       "1695  Thu Jun 05 20:42:05 +0000 2014  JNkappers 2018-01-20 02:45:29.395627   \n",
       "\n",
       "      retweet_count                                               text  \\\n",
       "0                 0  The royals, just like us \\nhttps://t.co/dttTM8...   \n",
       "1                 0  If people don't start their tweets with \"some ...   \n",
       "2                 0  Day 3 of excessive Juul usage, 3 pods deeps an...   \n",
       "3                 0    Siri, show treatment options for Juul addiction   \n",
       "4                 0                   Looooool https://t.co/v2qEKd5uDR   \n",
       "5                 0    @ko14vonn @TabMediaInc Yeah ofc, dm me whenever   \n",
       "6                 0  @ko14vonn @TabMediaInc I’ve worked for tab med...   \n",
       "7                 0  @ko14vonn Feel free to check out @TabMediaInc ...   \n",
       "8                 0  @leroy87dacosta @MasterofNone @azizansari http...   \n",
       "9                 0  The 11th Commandment of the LAD Bible: \"Thou s...   \n",
       "10                1    New year, new @HShukman https://t.co/eTHV3zwvJG   \n",
       "11                1  How has someone interviewed Floyd Mayweather, ...   \n",
       "12                0  Get it together lads, the family name is at st...   \n",
       "13                0  How has it got to the stage where I see 30 on ...   \n",
       "14                0  Just when you think @Quora isnt just white peo...   \n",
       "15                0                                               Fin.   \n",
       "16                0           “My mom’s calling ... how embarrassing,”   \n",
       "17                0  “Bro, my dad now arranged for you a $20bn deal...   \n",
       "18                0  \"My dad made an awesome deal for your dad, bro...   \n",
       "19                0                          “Bro, you got to spot me\"   \n",
       "20                0  The best quotes from Yair Netanyahu's outrageo...   \n",
       "21                0                                  @DixPeyton *fewer   \n",
       "22                0  Congrats on ur win James Franco, here are some...   \n",
       "23                0  I just wish Facebook had an option to hide any...   \n",
       "24                2  You vs. the guy she tells you not to worry abo...   \n",
       "25                0  I just.. I don't even know any more https://t....   \n",
       "26                0  And that man's name? Albert Einstein. https://...   \n",
       "27                0  I achieved something today! https://t.co/Rrs1v...   \n",
       "28                0  @GregBarradale you did it mate, you found the ...   \n",
       "29                0    @thebobpalmer Why were you at uni for 17 years?   \n",
       "...             ...                                                ...   \n",
       "1666              0   andrew marr, cutting as usual #coldstoreinslough   \n",
       "1667              0     Where's dimbledawg? I want my license fee back   \n",
       "1668              1  Who are the people that watch election coverag...   \n",
       "1669              0  Misty sunrise over the Berkshires from the rec...   \n",
       "1670              0  @ross_sian was in front of a packed restaurant...   \n",
       "1671              0  Walked face first into a glass door, broke my ...   \n",
       "1672              0  \"Our day at hatch\"- an abstract art piece from...   \n",
       "1673              0  @UoNSU I'm in the mood for something flame gri...   \n",
       "1674              0  Genuinely forgot that Plain Lazy clothes exist...   \n",
       "1675              0  Back home with ma bitch #demsurreyhillsdoe htt...   \n",
       "1676              0  BBC complaints reveal the big issues from whil...   \n",
       "1677              0  The view looking West from Citifield @ Citifie...   \n",
       "1678              0  Red Sox Blue Jays at Fenway @ Fenway Park http...   \n",
       "1679              0  Boston from the Charles river #ducktour @ Char...   \n",
       "1680              0                                @Zac_GB ur moist m8   \n",
       "1681              0  Watching #BRAvsMEX in an irish pub off times s...   \n",
       "1682              0  The fall of Eric Cantor is awful news for poli...   \n",
       "1683              0  Who are the people that need to buy duty free ...   \n",
       "1684              0  @NraWayne is the single most deluded man in we...   \n",
       "1685              0     You stay classy Cardiff http://t.co/HLVnB645Kl   \n",
       "1686              0  Who said London cabs were expensive? http://t....   \n",
       "1687              0  9 hours later, mans back in guildford via flee...   \n",
       "1688              0  Only took 7 hours, how time flies when you're ...   \n",
       "1689              0  @eastcoastuk are you able to say what they can...   \n",
       "1690              0  @eastcoastuk 18.45 Leeds to KingsX, I understa...   \n",
       "1691              0  Missed my connections and dangerously close to...   \n",
       "1692              0  Was quite looking forward to getting a job bef...   \n",
       "1693              0  Dissappointed to see that @netflix have kept t...   \n",
       "1694              0  @JakeReesMogg always brightens election covera...   \n",
       "1695              1  Two pints and change from a tenner, definitely...   \n",
       "\n",
       "                tweet_id  \n",
       "0     954008004927610880  \n",
       "1     953583065112117248  \n",
       "2     953223642741202945  \n",
       "3     952995071225417729  \n",
       "4     952915795146928128  \n",
       "5     952495771642974208  \n",
       "6     952493682468511744  \n",
       "7     952487748123942912  \n",
       "8     952486290842357760  \n",
       "9     951203804757753856  \n",
       "10    951198490004213763  \n",
       "11    951177849582612480  \n",
       "12    951115290405982208  \n",
       "13    950720564502630403  \n",
       "14    950574620893212672  \n",
       "15    950496919238905857  \n",
       "16    950496887655759872  \n",
       "17    950496596885680128  \n",
       "18    950496552220577792  \n",
       "19    950496485413740545  \n",
       "20    950496354144530432  \n",
       "21    950495273524060162  \n",
       "22    950195028651053056  \n",
       "23    949765030043705346  \n",
       "24    949397204078333953  \n",
       "25    949396242832019456  \n",
       "26    949293688638902272  \n",
       "27    949044829912227840  \n",
       "28    948950098486185984  \n",
       "29    948899459676758019  \n",
       "...                  ...  \n",
       "1666  512721406774087681  \n",
       "1667  512719025516716032  \n",
       "1668  512708283207925761  \n",
       "1669  512006928357019649  \n",
       "1670  511508289696571392  \n",
       "1671  511494076215361536  \n",
       "1672  511201139128143872  \n",
       "1673  510765773238046720  \n",
       "1674  508971924094189568  \n",
       "1675  508962306798002177  \n",
       "1676  508253958146899968  \n",
       "1677  505921030318084096  \n",
       "1678  494832252488912896  \n",
       "1679  494607223616987136  \n",
       "1680  481466458568785921  \n",
       "1681  478994282565476352  \n",
       "1682  476979790625640448  \n",
       "1683  476974658403966976  \n",
       "1684  476433252778246144  \n",
       "1685  476428866689724416  \n",
       "1686  476181172201209857  \n",
       "1687  476181079360282624  \n",
       "1688  476150998042701824  \n",
       "1689  476133312210415616  \n",
       "1690  476128524953456640  \n",
       "1691  476115452452941824  \n",
       "1692  474949041675964416  \n",
       "1693  474817498001731584  \n",
       "1694  474701231341207552  \n",
       "1695  474652400935268353  \n",
       "\n",
       "[1696 rows x 6 columns]"
      ]
     },
     "execution_count": 132,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "josh_tweets = pd.DataFrame(Josh)\n",
    "josh_tweets"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 133,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>created_at</th>\n",
       "      <th>handle</th>\n",
       "      <th>mined_at</th>\n",
       "      <th>retweet_count</th>\n",
       "      <th>text</th>\n",
       "      <th>tweet_id</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Fri Jan 19 16:44:44 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421313</td>\n",
       "      <td>0</td>\n",
       "      <td>#ff my sister @sarahfmcdonald for all your god...</td>\n",
       "      <td>954394205039792128</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Fri Jan 19 16:34:40 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421339</td>\n",
       "      <td>0</td>\n",
       "      <td>@mikemancini my god</td>\n",
       "      <td>954391670052843520</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Thu Jan 18 23:39:24 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421350</td>\n",
       "      <td>0</td>\n",
       "      <td>@TheTab also just seven-balled @mattgibson27 a...</td>\n",
       "      <td>954136169293471744</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Thu Jan 18 23:25:42 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421392</td>\n",
       "      <td>0</td>\n",
       "      <td>@Ned_Donovan @TheTab the tab dot com is kinda ...</td>\n",
       "      <td>954132719918878720</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Thu Jan 18 23:17:39 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421399</td>\n",
       "      <td>1</td>\n",
       "      <td>hate to brag but @TheTab’s american college ac...</td>\n",
       "      <td>954130696334970880</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Thu Jan 18 17:13:59 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421406</td>\n",
       "      <td>1</td>\n",
       "      <td>this president is a goner https://t.co/pCzqwakFes</td>\n",
       "      <td>954039176755851264</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Thu Jan 18 17:08:04 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421412</td>\n",
       "      <td>0</td>\n",
       "      <td>@GregBarradale @JNkappers it took you four day...</td>\n",
       "      <td>954037686037286913</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Thu Jan 18 16:23:52 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421419</td>\n",
       "      <td>0</td>\n",
       "      <td>sing it from the rooftops https://t.co/m27XucqlT4</td>\n",
       "      <td>954026565473619975</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Thu Jan 18 16:19:28 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421425</td>\n",
       "      <td>0</td>\n",
       "      <td>@cschlt @LeadershipInst it has been alleged th...</td>\n",
       "      <td>954025456113733632</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Thu Jan 18 14:49:33 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421431</td>\n",
       "      <td>1</td>\n",
       "      <td>to have the TEMERITY to do this is nuts https:...</td>\n",
       "      <td>954002829986942978</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>Thu Jan 18 14:43:07 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421437</td>\n",
       "      <td>0</td>\n",
       "      <td>here are my favorite parts of the leadership i...</td>\n",
       "      <td>954001208825581569</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Thu Jan 18 03:55:37 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421443</td>\n",
       "      <td>0</td>\n",
       "      <td>i used to sell pigs’ cheeks on a butcher’s cou...</td>\n",
       "      <td>953838261503447040</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Wed Jan 17 22:36:33 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421449</td>\n",
       "      <td>0</td>\n",
       "      <td>this is such a good own on the @guardian sport...</td>\n",
       "      <td>953757963793195011</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Wed Jan 17 20:25:07 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421456</td>\n",
       "      <td>0</td>\n",
       "      <td>@sierra_infinity @twinpeaksmeme</td>\n",
       "      <td>953724890447843336</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Wed Jan 17 15:44:22 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421462</td>\n",
       "      <td>0</td>\n",
       "      <td>@jk_rowling The urban legend at Exeter Uni was...</td>\n",
       "      <td>953654236402929664</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Tue Jan 16 21:50:17 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421468</td>\n",
       "      <td>0</td>\n",
       "      <td>@FarleyWrites @wooodham</td>\n",
       "      <td>953383932778643461</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Tue Jan 16 20:56:02 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421474</td>\n",
       "      <td>0</td>\n",
       "      <td>old people don't know anything about anything</td>\n",
       "      <td>953370283238445057</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>Tue Jan 16 19:33:35 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421479</td>\n",
       "      <td>1</td>\n",
       "      <td>struggling to believe that this is the first e...</td>\n",
       "      <td>953349531101523969</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>Tue Jan 16 01:35:37 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421486</td>\n",
       "      <td>0</td>\n",
       "      <td>@_CupOfT @DanaSchwartzzz you would love each o...</td>\n",
       "      <td>953078253916434432</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>Mon Jan 15 21:04:27 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421491</td>\n",
       "      <td>0</td>\n",
       "      <td>fuck you very much @google https://t.co/SGqD2B...</td>\n",
       "      <td>953010011818680320</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Mon Jan 15 20:06:19 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421497</td>\n",
       "      <td>0</td>\n",
       "      <td>@JNkappers  https://t.co/eiigDFWUUr</td>\n",
       "      <td>952995381809426433</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>Mon Jan 15 14:47:15 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421503</td>\n",
       "      <td>0</td>\n",
       "      <td>overheard in my head every day: https://t.co/X...</td>\n",
       "      <td>952915086770933760</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>Sun Jan 14 05:14:30 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421509</td>\n",
       "      <td>0</td>\n",
       "      <td>how dare you promote this to me @tide https://...</td>\n",
       "      <td>952408562420060161</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>Sat Jan 13 20:13:55 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421515</td>\n",
       "      <td>0</td>\n",
       "      <td>what doesn’t kill you makes you stronger https...</td>\n",
       "      <td>952272517598797824</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>Sat Jan 13 00:14:12 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421521</td>\n",
       "      <td>0</td>\n",
       "      <td>@wainz_world when you’re out with colleagues a...</td>\n",
       "      <td>951970601303932928</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>Fri Jan 12 23:46:23 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421525</td>\n",
       "      <td>1</td>\n",
       "      <td>seeing the word ‘shithole’ everywhere today ha...</td>\n",
       "      <td>951963600419160064</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>Fri Jan 12 22:38:46 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421532</td>\n",
       "      <td>0</td>\n",
       "      <td>the @adidas calling all creators campaign make...</td>\n",
       "      <td>951946581569343488</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>Fri Jan 12 22:35:18 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421538</td>\n",
       "      <td>0</td>\n",
       "      <td>@SunPolitics @MrHarryCole harry why do you car...</td>\n",
       "      <td>951945710278184960</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>Fri Jan 12 00:52:56 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421544</td>\n",
       "      <td>0</td>\n",
       "      <td>@VICE @HShukman</td>\n",
       "      <td>951617958291402753</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>Thu Jan 11 17:29:28 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421550</td>\n",
       "      <td>0</td>\n",
       "      <td>@estwebber @Tom_Jenkin91 you must be so proud</td>\n",
       "      <td>951506356875546624</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2233</th>\n",
       "      <td>Thu Feb 12 15:30:09 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781302</td>\n",
       "      <td>0</td>\n",
       "      <td>@Nero @HShukman graduating from Cambridge and ...</td>\n",
       "      <td>565895642594439168</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2234</th>\n",
       "      <td>Thu Feb 12 13:49:16 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781306</td>\n",
       "      <td>0</td>\n",
       "      <td>@harrythieves what, Leonard Street? By Green P...</td>\n",
       "      <td>565870255759966208</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2235</th>\n",
       "      <td>Thu Feb 12 13:44:41 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781311</td>\n",
       "      <td>0</td>\n",
       "      <td>@harrythieves *Whitecross Market</td>\n",
       "      <td>565869100359221248</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2236</th>\n",
       "      <td>Thu Feb 12 13:41:37 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781315</td>\n",
       "      <td>0</td>\n",
       "      <td>regret a manger</td>\n",
       "      <td>565868329169350656</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2237</th>\n",
       "      <td>Thu Feb 12 13:11:31 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781319</td>\n",
       "      <td>1</td>\n",
       "      <td>I got rejected from Cambridge in 2008 and Oxfo...</td>\n",
       "      <td>565860754688327680</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2238</th>\n",
       "      <td>Thu Feb 12 12:52:53 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781323</td>\n",
       "      <td>1</td>\n",
       "      <td>@sarahfmcdonald I hear some Jewish lads had a ...</td>\n",
       "      <td>565856066190458880</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2239</th>\n",
       "      <td>Wed Feb 11 15:04:23 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781327</td>\n",
       "      <td>0</td>\n",
       "      <td>message me 4 guestlist: http://t.co/oHLkKEGw7R</td>\n",
       "      <td>565526770066415619</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2240</th>\n",
       "      <td>Sat Feb 07 14:35:46 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781332</td>\n",
       "      <td>0</td>\n",
       "      <td>@charleswhite3 the ring chooses the ring-bearer.</td>\n",
       "      <td>564070017378304000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2241</th>\n",
       "      <td>Sat Feb 07 14:34:39 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781336</td>\n",
       "      <td>0</td>\n",
       "      <td>@charleswhite3 I asked for one for Christmas. ...</td>\n",
       "      <td>564069736036962305</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2242</th>\n",
       "      <td>Sat Feb 07 14:31:33 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781341</td>\n",
       "      <td>0</td>\n",
       "      <td>@charleswhite3 that is so uni</td>\n",
       "      <td>564068954722025474</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2243</th>\n",
       "      <td>Sat Feb 07 14:30:40 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781345</td>\n",
       "      <td>0</td>\n",
       "      <td>SHIT! DID YOU SEE THAT?!</td>\n",
       "      <td>564068731677343744</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2244</th>\n",
       "      <td>Sat Feb 07 14:28:49 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781350</td>\n",
       "      <td>0</td>\n",
       "      <td>@charleswhite3 ooh, where?</td>\n",
       "      <td>564068268856836096</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2245</th>\n",
       "      <td>Sat Feb 07 14:20:05 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781354</td>\n",
       "      <td>0</td>\n",
       "      <td>The kebab I had from @Mangal2 last night: grea...</td>\n",
       "      <td>564066069401587712</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2246</th>\n",
       "      <td>Sat Feb 07 13:43:19 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781359</td>\n",
       "      <td>0</td>\n",
       "      <td>@Liam__Evans I know, we're all over them.</td>\n",
       "      <td>564056817651949568</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2247</th>\n",
       "      <td>Fri Feb 06 12:20:48 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781363</td>\n",
       "      <td>0</td>\n",
       "      <td>@Jonny_Singer please show this to the next pla...</td>\n",
       "      <td>563673661459402752</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2248</th>\n",
       "      <td>Fri Feb 06 12:20:26 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781368</td>\n",
       "      <td>0</td>\n",
       "      <td>This one goes out to the boy in Bata @Jonny_Si...</td>\n",
       "      <td>563673570539483136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2249</th>\n",
       "      <td>Wed Feb 04 15:35:59 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781372</td>\n",
       "      <td>0</td>\n",
       "      <td>@ExeterUniRL https://t.co/4Dvru1pApf</td>\n",
       "      <td>562998005637607425</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2250</th>\n",
       "      <td>Wed Feb 04 15:14:43 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781377</td>\n",
       "      <td>0</td>\n",
       "      <td>@ExeterUniRL what's the score?!</td>\n",
       "      <td>562992653789581312</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2251</th>\n",
       "      <td>Mon Feb 02 18:58:36 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781381</td>\n",
       "      <td>0</td>\n",
       "      <td>An invigorating evening read from @kj_corcoran...</td>\n",
       "      <td>562324220936744960</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2252</th>\n",
       "      <td>Mon Feb 02 17:27:59 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781385</td>\n",
       "      <td>1</td>\n",
       "      <td>This whole piece by @OliDugmore reads like an ...</td>\n",
       "      <td>562301415876755456</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2253</th>\n",
       "      <td>Fri Jan 30 11:20:40 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781390</td>\n",
       "      <td>0</td>\n",
       "      <td>Kid put in isolation for having good lid. Ridi...</td>\n",
       "      <td>561121814764879872</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2254</th>\n",
       "      <td>Thu Jan 29 17:54:54 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781394</td>\n",
       "      <td>0</td>\n",
       "      <td>@Liam__Evans @Tom_Jenkin91 @imcraigoc can't yo...</td>\n",
       "      <td>560858637435158528</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2255</th>\n",
       "      <td>Wed Jan 28 23:56:57 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781399</td>\n",
       "      <td>0</td>\n",
       "      <td>@sarahfmcdonald it doesn't happen unless it ha...</td>\n",
       "      <td>560587364838670339</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2256</th>\n",
       "      <td>Wed Jan 28 23:46:20 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781402</td>\n",
       "      <td>1</td>\n",
       "      <td>@sarahfmcdonald she prayed to it aloud as she ...</td>\n",
       "      <td>560584694551830528</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2257</th>\n",
       "      <td>Wed Jan 28 23:45:55 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781405</td>\n",
       "      <td>1</td>\n",
       "      <td>@sarahfmcdonald after an hour and a half of ch...</td>\n",
       "      <td>560584589379649536</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2258</th>\n",
       "      <td>Wed Jan 28 23:44:57 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781409</td>\n",
       "      <td>1</td>\n",
       "      <td>My sister @sarahfmcdonald just killed the shit...</td>\n",
       "      <td>560584342460989440</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2259</th>\n",
       "      <td>Wed Jan 28 22:23:24 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781413</td>\n",
       "      <td>0</td>\n",
       "      <td>@Tom_Jenkin91 @imcraigoc? @Liam__Evans?</td>\n",
       "      <td>560563821828648960</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2260</th>\n",
       "      <td>Wed Jan 28 22:18:49 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781418</td>\n",
       "      <td>0</td>\n",
       "      <td>Would anyone like to come with me and @Tom_Jen...</td>\n",
       "      <td>560562666310479874</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2261</th>\n",
       "      <td>Wed Jan 28 18:52:49 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781423</td>\n",
       "      <td>0</td>\n",
       "      <td>@LisaFoxWrites @TheTab editor@tab.co.uk</td>\n",
       "      <td>560510825015029763</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2262</th>\n",
       "      <td>Wed Jan 28 18:51:20 +0000 2015</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:38.781427</td>\n",
       "      <td>0</td>\n",
       "      <td>@Christina_SvR @TheTab had to shove it in with...</td>\n",
       "      <td>560510454754463744</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2263 rows × 6 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                          created_at           handle  \\\n",
       "0     Fri Jan 19 16:44:44 +0000 2018  mattjpfmcdonald   \n",
       "1     Fri Jan 19 16:34:40 +0000 2018  mattjpfmcdonald   \n",
       "2     Thu Jan 18 23:39:24 +0000 2018  mattjpfmcdonald   \n",
       "3     Thu Jan 18 23:25:42 +0000 2018  mattjpfmcdonald   \n",
       "4     Thu Jan 18 23:17:39 +0000 2018  mattjpfmcdonald   \n",
       "5     Thu Jan 18 17:13:59 +0000 2018  mattjpfmcdonald   \n",
       "6     Thu Jan 18 17:08:04 +0000 2018  mattjpfmcdonald   \n",
       "7     Thu Jan 18 16:23:52 +0000 2018  mattjpfmcdonald   \n",
       "8     Thu Jan 18 16:19:28 +0000 2018  mattjpfmcdonald   \n",
       "9     Thu Jan 18 14:49:33 +0000 2018  mattjpfmcdonald   \n",
       "10    Thu Jan 18 14:43:07 +0000 2018  mattjpfmcdonald   \n",
       "11    Thu Jan 18 03:55:37 +0000 2018  mattjpfmcdonald   \n",
       "12    Wed Jan 17 22:36:33 +0000 2018  mattjpfmcdonald   \n",
       "13    Wed Jan 17 20:25:07 +0000 2018  mattjpfmcdonald   \n",
       "14    Wed Jan 17 15:44:22 +0000 2018  mattjpfmcdonald   \n",
       "15    Tue Jan 16 21:50:17 +0000 2018  mattjpfmcdonald   \n",
       "16    Tue Jan 16 20:56:02 +0000 2018  mattjpfmcdonald   \n",
       "17    Tue Jan 16 19:33:35 +0000 2018  mattjpfmcdonald   \n",
       "18    Tue Jan 16 01:35:37 +0000 2018  mattjpfmcdonald   \n",
       "19    Mon Jan 15 21:04:27 +0000 2018  mattjpfmcdonald   \n",
       "20    Mon Jan 15 20:06:19 +0000 2018  mattjpfmcdonald   \n",
       "21    Mon Jan 15 14:47:15 +0000 2018  mattjpfmcdonald   \n",
       "22    Sun Jan 14 05:14:30 +0000 2018  mattjpfmcdonald   \n",
       "23    Sat Jan 13 20:13:55 +0000 2018  mattjpfmcdonald   \n",
       "24    Sat Jan 13 00:14:12 +0000 2018  mattjpfmcdonald   \n",
       "25    Fri Jan 12 23:46:23 +0000 2018  mattjpfmcdonald   \n",
       "26    Fri Jan 12 22:38:46 +0000 2018  mattjpfmcdonald   \n",
       "27    Fri Jan 12 22:35:18 +0000 2018  mattjpfmcdonald   \n",
       "28    Fri Jan 12 00:52:56 +0000 2018  mattjpfmcdonald   \n",
       "29    Thu Jan 11 17:29:28 +0000 2018  mattjpfmcdonald   \n",
       "...                              ...              ...   \n",
       "2233  Thu Feb 12 15:30:09 +0000 2015  mattjpfmcdonald   \n",
       "2234  Thu Feb 12 13:49:16 +0000 2015  mattjpfmcdonald   \n",
       "2235  Thu Feb 12 13:44:41 +0000 2015  mattjpfmcdonald   \n",
       "2236  Thu Feb 12 13:41:37 +0000 2015  mattjpfmcdonald   \n",
       "2237  Thu Feb 12 13:11:31 +0000 2015  mattjpfmcdonald   \n",
       "2238  Thu Feb 12 12:52:53 +0000 2015  mattjpfmcdonald   \n",
       "2239  Wed Feb 11 15:04:23 +0000 2015  mattjpfmcdonald   \n",
       "2240  Sat Feb 07 14:35:46 +0000 2015  mattjpfmcdonald   \n",
       "2241  Sat Feb 07 14:34:39 +0000 2015  mattjpfmcdonald   \n",
       "2242  Sat Feb 07 14:31:33 +0000 2015  mattjpfmcdonald   \n",
       "2243  Sat Feb 07 14:30:40 +0000 2015  mattjpfmcdonald   \n",
       "2244  Sat Feb 07 14:28:49 +0000 2015  mattjpfmcdonald   \n",
       "2245  Sat Feb 07 14:20:05 +0000 2015  mattjpfmcdonald   \n",
       "2246  Sat Feb 07 13:43:19 +0000 2015  mattjpfmcdonald   \n",
       "2247  Fri Feb 06 12:20:48 +0000 2015  mattjpfmcdonald   \n",
       "2248  Fri Feb 06 12:20:26 +0000 2015  mattjpfmcdonald   \n",
       "2249  Wed Feb 04 15:35:59 +0000 2015  mattjpfmcdonald   \n",
       "2250  Wed Feb 04 15:14:43 +0000 2015  mattjpfmcdonald   \n",
       "2251  Mon Feb 02 18:58:36 +0000 2015  mattjpfmcdonald   \n",
       "2252  Mon Feb 02 17:27:59 +0000 2015  mattjpfmcdonald   \n",
       "2253  Fri Jan 30 11:20:40 +0000 2015  mattjpfmcdonald   \n",
       "2254  Thu Jan 29 17:54:54 +0000 2015  mattjpfmcdonald   \n",
       "2255  Wed Jan 28 23:56:57 +0000 2015  mattjpfmcdonald   \n",
       "2256  Wed Jan 28 23:46:20 +0000 2015  mattjpfmcdonald   \n",
       "2257  Wed Jan 28 23:45:55 +0000 2015  mattjpfmcdonald   \n",
       "2258  Wed Jan 28 23:44:57 +0000 2015  mattjpfmcdonald   \n",
       "2259  Wed Jan 28 22:23:24 +0000 2015  mattjpfmcdonald   \n",
       "2260  Wed Jan 28 22:18:49 +0000 2015  mattjpfmcdonald   \n",
       "2261  Wed Jan 28 18:52:49 +0000 2015  mattjpfmcdonald   \n",
       "2262  Wed Jan 28 18:51:20 +0000 2015  mattjpfmcdonald   \n",
       "\n",
       "                       mined_at  retweet_count  \\\n",
       "0    2018-01-20 02:45:30.421313              0   \n",
       "1    2018-01-20 02:45:30.421339              0   \n",
       "2    2018-01-20 02:45:30.421350              0   \n",
       "3    2018-01-20 02:45:30.421392              0   \n",
       "4    2018-01-20 02:45:30.421399              1   \n",
       "5    2018-01-20 02:45:30.421406              1   \n",
       "6    2018-01-20 02:45:30.421412              0   \n",
       "7    2018-01-20 02:45:30.421419              0   \n",
       "8    2018-01-20 02:45:30.421425              0   \n",
       "9    2018-01-20 02:45:30.421431              1   \n",
       "10   2018-01-20 02:45:30.421437              0   \n",
       "11   2018-01-20 02:45:30.421443              0   \n",
       "12   2018-01-20 02:45:30.421449              0   \n",
       "13   2018-01-20 02:45:30.421456              0   \n",
       "14   2018-01-20 02:45:30.421462              0   \n",
       "15   2018-01-20 02:45:30.421468              0   \n",
       "16   2018-01-20 02:45:30.421474              0   \n",
       "17   2018-01-20 02:45:30.421479              1   \n",
       "18   2018-01-20 02:45:30.421486              0   \n",
       "19   2018-01-20 02:45:30.421491              0   \n",
       "20   2018-01-20 02:45:30.421497              0   \n",
       "21   2018-01-20 02:45:30.421503              0   \n",
       "22   2018-01-20 02:45:30.421509              0   \n",
       "23   2018-01-20 02:45:30.421515              0   \n",
       "24   2018-01-20 02:45:30.421521              0   \n",
       "25   2018-01-20 02:45:30.421525              1   \n",
       "26   2018-01-20 02:45:30.421532              0   \n",
       "27   2018-01-20 02:45:30.421538              0   \n",
       "28   2018-01-20 02:45:30.421544              0   \n",
       "29   2018-01-20 02:45:30.421550              0   \n",
       "...                         ...            ...   \n",
       "2233 2018-01-20 02:45:38.781302              0   \n",
       "2234 2018-01-20 02:45:38.781306              0   \n",
       "2235 2018-01-20 02:45:38.781311              0   \n",
       "2236 2018-01-20 02:45:38.781315              0   \n",
       "2237 2018-01-20 02:45:38.781319              1   \n",
       "2238 2018-01-20 02:45:38.781323              1   \n",
       "2239 2018-01-20 02:45:38.781327              0   \n",
       "2240 2018-01-20 02:45:38.781332              0   \n",
       "2241 2018-01-20 02:45:38.781336              0   \n",
       "2242 2018-01-20 02:45:38.781341              0   \n",
       "2243 2018-01-20 02:45:38.781345              0   \n",
       "2244 2018-01-20 02:45:38.781350              0   \n",
       "2245 2018-01-20 02:45:38.781354              0   \n",
       "2246 2018-01-20 02:45:38.781359              0   \n",
       "2247 2018-01-20 02:45:38.781363              0   \n",
       "2248 2018-01-20 02:45:38.781368              0   \n",
       "2249 2018-01-20 02:45:38.781372              0   \n",
       "2250 2018-01-20 02:45:38.781377              0   \n",
       "2251 2018-01-20 02:45:38.781381              0   \n",
       "2252 2018-01-20 02:45:38.781385              1   \n",
       "2253 2018-01-20 02:45:38.781390              0   \n",
       "2254 2018-01-20 02:45:38.781394              0   \n",
       "2255 2018-01-20 02:45:38.781399              0   \n",
       "2256 2018-01-20 02:45:38.781402              1   \n",
       "2257 2018-01-20 02:45:38.781405              1   \n",
       "2258 2018-01-20 02:45:38.781409              1   \n",
       "2259 2018-01-20 02:45:38.781413              0   \n",
       "2260 2018-01-20 02:45:38.781418              0   \n",
       "2261 2018-01-20 02:45:38.781423              0   \n",
       "2262 2018-01-20 02:45:38.781427              0   \n",
       "\n",
       "                                                   text            tweet_id  \n",
       "0     #ff my sister @sarahfmcdonald for all your god...  954394205039792128  \n",
       "1                                   @mikemancini my god  954391670052843520  \n",
       "2     @TheTab also just seven-balled @mattgibson27 a...  954136169293471744  \n",
       "3     @Ned_Donovan @TheTab the tab dot com is kinda ...  954132719918878720  \n",
       "4     hate to brag but @TheTab’s american college ac...  954130696334970880  \n",
       "5     this president is a goner https://t.co/pCzqwakFes  954039176755851264  \n",
       "6     @GregBarradale @JNkappers it took you four day...  954037686037286913  \n",
       "7     sing it from the rooftops https://t.co/m27XucqlT4  954026565473619975  \n",
       "8     @cschlt @LeadershipInst it has been alleged th...  954025456113733632  \n",
       "9     to have the TEMERITY to do this is nuts https:...  954002829986942978  \n",
       "10    here are my favorite parts of the leadership i...  954001208825581569  \n",
       "11    i used to sell pigs’ cheeks on a butcher’s cou...  953838261503447040  \n",
       "12    this is such a good own on the @guardian sport...  953757963793195011  \n",
       "13                      @sierra_infinity @twinpeaksmeme  953724890447843336  \n",
       "14    @jk_rowling The urban legend at Exeter Uni was...  953654236402929664  \n",
       "15                              @FarleyWrites @wooodham  953383932778643461  \n",
       "16        old people don't know anything about anything  953370283238445057  \n",
       "17    struggling to believe that this is the first e...  953349531101523969  \n",
       "18    @_CupOfT @DanaSchwartzzz you would love each o...  953078253916434432  \n",
       "19    fuck you very much @google https://t.co/SGqD2B...  953010011818680320  \n",
       "20                  @JNkappers  https://t.co/eiigDFWUUr  952995381809426433  \n",
       "21    overheard in my head every day: https://t.co/X...  952915086770933760  \n",
       "22    how dare you promote this to me @tide https://...  952408562420060161  \n",
       "23    what doesn’t kill you makes you stronger https...  952272517598797824  \n",
       "24    @wainz_world when you’re out with colleagues a...  951970601303932928  \n",
       "25    seeing the word ‘shithole’ everywhere today ha...  951963600419160064  \n",
       "26    the @adidas calling all creators campaign make...  951946581569343488  \n",
       "27    @SunPolitics @MrHarryCole harry why do you car...  951945710278184960  \n",
       "28                                      @VICE @HShukman  951617958291402753  \n",
       "29        @estwebber @Tom_Jenkin91 you must be so proud  951506356875546624  \n",
       "...                                                 ...                 ...  \n",
       "2233  @Nero @HShukman graduating from Cambridge and ...  565895642594439168  \n",
       "2234  @harrythieves what, Leonard Street? By Green P...  565870255759966208  \n",
       "2235                   @harrythieves *Whitecross Market  565869100359221248  \n",
       "2236                                    regret a manger  565868329169350656  \n",
       "2237  I got rejected from Cambridge in 2008 and Oxfo...  565860754688327680  \n",
       "2238  @sarahfmcdonald I hear some Jewish lads had a ...  565856066190458880  \n",
       "2239     message me 4 guestlist: http://t.co/oHLkKEGw7R  565526770066415619  \n",
       "2240   @charleswhite3 the ring chooses the ring-bearer.  564070017378304000  \n",
       "2241  @charleswhite3 I asked for one for Christmas. ...  564069736036962305  \n",
       "2242                      @charleswhite3 that is so uni  564068954722025474  \n",
       "2243                           SHIT! DID YOU SEE THAT?!  564068731677343744  \n",
       "2244                         @charleswhite3 ooh, where?  564068268856836096  \n",
       "2245  The kebab I had from @Mangal2 last night: grea...  564066069401587712  \n",
       "2246          @Liam__Evans I know, we're all over them.  564056817651949568  \n",
       "2247  @Jonny_Singer please show this to the next pla...  563673661459402752  \n",
       "2248  This one goes out to the boy in Bata @Jonny_Si...  563673570539483136  \n",
       "2249               @ExeterUniRL https://t.co/4Dvru1pApf  562998005637607425  \n",
       "2250                    @ExeterUniRL what's the score?!  562992653789581312  \n",
       "2251  An invigorating evening read from @kj_corcoran...  562324220936744960  \n",
       "2252  This whole piece by @OliDugmore reads like an ...  562301415876755456  \n",
       "2253  Kid put in isolation for having good lid. Ridi...  561121814764879872  \n",
       "2254  @Liam__Evans @Tom_Jenkin91 @imcraigoc can't yo...  560858637435158528  \n",
       "2255  @sarahfmcdonald it doesn't happen unless it ha...  560587364838670339  \n",
       "2256  @sarahfmcdonald she prayed to it aloud as she ...  560584694551830528  \n",
       "2257  @sarahfmcdonald after an hour and a half of ch...  560584589379649536  \n",
       "2258  My sister @sarahfmcdonald just killed the shit...  560584342460989440  \n",
       "2259            @Tom_Jenkin91 @imcraigoc? @Liam__Evans?  560563821828648960  \n",
       "2260  Would anyone like to come with me and @Tom_Jen...  560562666310479874  \n",
       "2261            @LisaFoxWrites @TheTab editor@tab.co.uk  560510825015029763  \n",
       "2262  @Christina_SvR @TheTab had to shove it in with...  560510454754463744  \n",
       "\n",
       "[2263 rows x 6 columns]"
      ]
     },
     "execution_count": 133,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "matt_tweets = pd.DataFrame(Matt)\n",
    "matt_tweets"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 134,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(3959, 6)"
      ]
     },
     "execution_count": 134,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tweets2 = pd.concat([josh_tweets, matt_tweets], axis=0)\n",
    "tweets2.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 135,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[(u'https wkz7janfeg', 51),\n",
       " (u'follow dm', 27),\n",
       " (u'nick_clegg borisjohnson', 25),\n",
       " (u'details https', 16),\n",
       " (u'nick_clegg borisjohnson ed_miliband', 15),\n",
       " (u'details https wkz7janfeg', 15),\n",
       " (u'borisjohnson ed_miliband', 15),\n",
       " (u'write piece', 14),\n",
       " (u'journo looking shadow', 13),\n",
       " (u'shift write', 13),\n",
       " (u'journo looking shadow junior', 13),\n",
       " (u'piece job like interested', 13),\n",
       " (u'looking shadow', 13),\n",
       " (u'write piece job like', 13),\n",
       " (u'piece job like', 13),\n",
       " (u'job like', 13),\n",
       " (u'like interested', 13),\n",
       " (u'journo looking', 13),\n",
       " (u'job like interested', 13),\n",
       " (u'shift write piece job', 13)]"
      ]
     },
     "execution_count": 135,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# We can use the TfidfVectorizer to find ngrams for us\n",
    "vect = TfidfVectorizer(ngram_range=(2,4), stop_words='english')\n",
    "\n",
    "# Pulls all of Josh's tweet text's into one giant string\n",
    "summaries = \"\".join(josh_tweets['text'])\n",
    "ngrams_summaries = vect.build_analyzer()(summaries)\n",
    "\n",
    "Counter(ngrams_summaries).most_common(20)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 136,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[(u'thetab https', 40),\n",
       " (u'hshukman thetab', 15),\n",
       " (u'babedotnet carolinephinney', 13),\n",
       " (u'rncincle https', 12),\n",
       " (u'thetab story', 10),\n",
       " (u'thetab exclusive', 10),\n",
       " (u'thetab com', 9),\n",
       " (u'piersmorgan spursofficial', 8),\n",
       " (u'ericandalli piersmorgan', 8),\n",
       " (u'fake news', 8),\n",
       " (u'thetab scoop', 8),\n",
       " (u'rewrite thetab', 8),\n",
       " (u'marvel dccomics', 8),\n",
       " (u'april fools', 8),\n",
       " (u'ericandalli piersmorgan spursofficial', 8),\n",
       " (u'like https', 7),\n",
       " (u'ago https', 7),\n",
       " (u'link https', 7),\n",
       " (u'carolinephinney itsamandaross', 7),\n",
       " (u'thetab babeswhodgaf', 7)]"
      ]
     },
     "execution_count": 136,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# We can use the TfidfVectorizer to find ngrams for us\n",
    "vect = TfidfVectorizer(ngram_range=(2,4), stop_words='english')\n",
    "\n",
    "# Pulls all of Matt's tweet text's into one giant string\n",
    "summaries = \"\".join(matt_tweets['text'])\n",
    "ngrams_summaries = vect.build_analyzer()(summaries)\n",
    "\n",
    "Counter(ngrams_summaries).most_common(20)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 138,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "tweet_text2 = tweets2['text'].values\n",
    "clean_text2 = [preprocess_text(x, fix_unicode=True, lowercase=True, no_urls=True, no_emails=True, no_phone_numbers=True, no_currency_symbols=True,\n",
    "                              no_punct=True, no_accents=True)\n",
    "              for x in tweet_text2]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 139,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[u'if people dont start their tweets with some personal news how am i supposed to know who to mute', u'day 3 of excessive juul usage 3 pods deeps and i cant remember what it feels like to not taste mangoes with every breath', u'siri show treatment options for juul addiction', u'looooool url', u'ko14vonn tabmediainc yeah ofc dm me whenever', u'ko14vonn tabmediainc ive worked for tab media for a few years and happy to answer any more you have', u'ko14vonn feel free to check out tabmediainc for more details on who owns and publishes url feels pretty transparent to me']\n"
     ]
    }
   ],
   "source": [
    "print clean_text2[1:8]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 140,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.57160899217\n"
     ]
    }
   ],
   "source": [
    "y2 = tweets2['handle'].map(lambda x: 1 if x == 'mattjpfmcdonald' else 0).values\n",
    "print max(pd.Series(y2).value_counts(normalize=True))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 141,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(3959, 2000)\n"
     ]
    }
   ],
   "source": [
    "tfv = TfidfVectorizer(ngram_range=(1,5), max_features=2000)\n",
    "X2 = tfv.fit_transform(clean_text2).todense()\n",
    "print X2.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 142,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Fitting 10 folds for each of 200 candidates, totalling 2000 fits\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "[Parallel(n_jobs=1)]: Done 2000 out of 2000 | elapsed:  1.7min finished\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "GridSearchCV(cv=10, error_score='raise',\n",
       "       estimator=LogisticRegression(C=1.0, class_weight=None, dual=False, fit_intercept=True,\n",
       "          intercept_scaling=1, max_iter=100, multi_class='ovr', n_jobs=1,\n",
       "          penalty='l2', random_state=None, solver='liblinear', tol=0.0001,\n",
       "          verbose=0, warm_start=False),\n",
       "       fit_params=None, iid=True, n_jobs=1,\n",
       "       param_grid={'penalty': ['l1', 'l2'], 'C': array([  1.00000e-05,   1.12332e-05, ...,   8.90215e-01,   1.00000e+00])},\n",
       "       pre_dispatch='2*n_jobs', refit=True, return_train_score='warn',\n",
       "       scoring=None, verbose=1)"
      ]
     },
     "execution_count": 142,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "lr2 = LogisticRegression()\n",
    "params2 = {'penalty': ['l1', 'l2'], 'C':np.logspace(-5,0,100)}\n",
    "#Grid searching to find optimal parameters for Logistic Regression\n",
    "gs_2 = GridSearchCV(lr2, param_grid=params2, cv=10, verbose=1)\n",
    "gs_2.fit(X2, y2)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 144,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'penalty': 'l2', 'C': 1.0}\n",
      "0.664056579944\n"
     ]
    }
   ],
   "source": [
    "print gs_2.best_params_\n",
    "print gs_2.best_score_"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 145,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.664034627756\n",
      "0.57160899217\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "[Parallel(n_jobs=1)]: Done  10 out of  10 | elapsed:    0.6s finished\n"
     ]
    }
   ],
   "source": [
    "accuracies = cross_val_score(LogisticRegression(), X2, y2, cv=10, verbose=1)\n",
    "\n",
    "print accuracies.mean()\n",
    "print y2.mean()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 147,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Proba_Josh</th>\n",
       "      <th>Proba_Matt</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0.606615</td>\n",
       "      <td>0.393385</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0.312974</td>\n",
       "      <td>0.687026</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Proba_Josh  Proba_Matt\n",
       "0    0.606615    0.393385\n",
       "1    0.312974    0.687026"
      ]
     },
     "execution_count": 147,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "estimator = LogisticRegression(penalty='l2', C=1.0)\n",
    "estimator.fit(X2,y2)\n",
    "\n",
    "# Prep our source as TfIdf vectors\n",
    "source_test = [\n",
    "    \"I just wish Facebook had an option to hide any content with Action Bronson, it would really make me happy\",\n",
    "    \"so my opening lines on bumble are so bad that girls unmatch me in some kind of men in black-style erasure of history. has happened twice.\"\n",
    "]\n",
    "\n",
    "Xtest = tfv.transform(source_test)\n",
    "pd.DataFrame(estimator.predict_proba(Xtest), columns=[\"Proba_Josh\", \"Proba_Matt\"])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 148,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 0.53613428,  0.46386572],\n",
       "       [ 0.34640514,  0.65359486],\n",
       "       [ 0.69202063,  0.30797937],\n",
       "       ..., \n",
       "       [ 0.52103154,  0.47896846],\n",
       "       [ 0.04148497,  0.95851503],\n",
       "       [ 0.08955179,  0.91044821]])"
      ]
     },
     "execution_count": 148,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "estimator.predict_proba(X2)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 149,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "Probas2 = pd.DataFrame(estimator.predict_proba(X2), columns=[\"Proba_Josh\", \"Proba_Matt\"])\n",
    "joined2 = pd.merge(tweets2, Probas2, left_index=True, right_index=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 150,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style>\n",
       "    .dataframe thead tr:only-child th {\n",
       "        text-align: right;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: left;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>created_at</th>\n",
       "      <th>handle</th>\n",
       "      <th>mined_at</th>\n",
       "      <th>retweet_count</th>\n",
       "      <th>text</th>\n",
       "      <th>tweet_id</th>\n",
       "      <th>Proba_Josh</th>\n",
       "      <th>Proba_Matt</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Thu Jan 18 15:10:07 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315685</td>\n",
       "      <td>0</td>\n",
       "      <td>The royals, just like us \\nhttps://t.co/dttTM8...</td>\n",
       "      <td>954008004927610880</td>\n",
       "      <td>0.536134</td>\n",
       "      <td>0.463866</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Fri Jan 19 16:44:44 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421313</td>\n",
       "      <td>0</td>\n",
       "      <td>#ff my sister @sarahfmcdonald for all your god...</td>\n",
       "      <td>954394205039792128</td>\n",
       "      <td>0.536134</td>\n",
       "      <td>0.463866</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Wed Jan 17 11:01:34 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315702</td>\n",
       "      <td>0</td>\n",
       "      <td>If people don't start their tweets with \"some ...</td>\n",
       "      <td>953583065112117248</td>\n",
       "      <td>0.346405</td>\n",
       "      <td>0.653595</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Fri Jan 19 16:34:40 +0000 2018</td>\n",
       "      <td>mattjpfmcdonald</td>\n",
       "      <td>2018-01-20 02:45:30.421339</td>\n",
       "      <td>0</td>\n",
       "      <td>@mikemancini my god</td>\n",
       "      <td>954391670052843520</td>\n",
       "      <td>0.346405</td>\n",
       "      <td>0.653595</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Tue Jan 16 11:13:21 +0000 2018</td>\n",
       "      <td>JNkappers</td>\n",
       "      <td>2018-01-20 02:45:22.315708</td>\n",
       "      <td>0</td>\n",
       "      <td>Day 3 of excessive Juul usage, 3 pods deeps an...</td>\n",
       "      <td>953223642741202945</td>\n",
       "      <td>0.692021</td>\n",
       "      <td>0.307979</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                       created_at           handle                   mined_at  \\\n",
       "0  Thu Jan 18 15:10:07 +0000 2018        JNkappers 2018-01-20 02:45:22.315685   \n",
       "0  Fri Jan 19 16:44:44 +0000 2018  mattjpfmcdonald 2018-01-20 02:45:30.421313   \n",
       "1  Wed Jan 17 11:01:34 +0000 2018        JNkappers 2018-01-20 02:45:22.315702   \n",
       "1  Fri Jan 19 16:34:40 +0000 2018  mattjpfmcdonald 2018-01-20 02:45:30.421339   \n",
       "2  Tue Jan 16 11:13:21 +0000 2018        JNkappers 2018-01-20 02:45:22.315708   \n",
       "\n",
       "   retweet_count                                               text  \\\n",
       "0              0  The royals, just like us \\nhttps://t.co/dttTM8...   \n",
       "0              0  #ff my sister @sarahfmcdonald for all your god...   \n",
       "1              0  If people don't start their tweets with \"some ...   \n",
       "1              0                                @mikemancini my god   \n",
       "2              0  Day 3 of excessive Juul usage, 3 pods deeps an...   \n",
       "\n",
       "             tweet_id  Proba_Josh  Proba_Matt  \n",
       "0  954008004927610880    0.536134    0.463866  \n",
       "0  954394205039792128    0.536134    0.463866  \n",
       "1  953583065112117248    0.346405    0.653595  \n",
       "1  954391670052843520    0.346405    0.653595  \n",
       "2  953223642741202945    0.692021    0.307979  "
      ]
     },
     "execution_count": 150,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "joined2.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 151,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Pls ur majesty @Queen_UK \n",
      "\n",
      "https://t.co/smJpOLJfew\n"
     ]
    }
   ],
   "source": [
    "joined_josh = joined2[joined2['handle']==\"JNkappers\"]\n",
    "for el in joined_josh[joined_josh['Proba_Josh']==max(joined_josh['Proba_Josh'])]['text']:\n",
    "    print el"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 152,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "@JordanStrack @joshi\n"
     ]
    }
   ],
   "source": [
    "for el in joined_josh[joined_josh['Proba_Josh']==min(joined_josh['Proba_Josh'])]['text']:\n",
    "    print el"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 153,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "#dookfans eat gluten-free produce when they're not coeliac\n"
     ]
    }
   ],
   "source": [
    "joined_matt = joined2[joined2['handle']==\"mattjpfmcdonald\"]\n",
    "for el in joined_matt[joined_matt['Proba_Matt']==max(joined_matt['Proba_Matt'])]['text']:\n",
    "    print el"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## I totally would have guessed that a tweet trolling Duke fans had the highest probability of being from Matt."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 154,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "@Oobahs the ones who aren't so freaked out that they never want to write again tend to go on to do great things\n"
     ]
    }
   ],
   "source": [
    "for el in joined_matt[joined_matt['Proba_Matt']==min(joined_matt['Proba_Matt'])]['text']:\n",
    "    print el"
   ]
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python 2",
   "language": "python",
   "name": "python2"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 2
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython2",
   "version": "2.7.14"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}